-- Logs begin at Wed 2021-02-17 17:10:07 UTC, end at Wed 2021-02-17 18:16:58 UTC. -- Feb 17 17:57:21.111937 dv-cinder-760194-3-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Feb 17 17:57:23.835445 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.common.config [-] Logging enabled! Feb 17 17:57:23.836006 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 17.1.0.dev527 Feb 17 17:57:23.837345 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=84000) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Feb 17 17:57:23.839140 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.common.config [-] Logging enabled! Feb 17 17:57:23.839434 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 17.1.0.dev527 Feb 17 17:57:23.839858 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=84000) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Feb 17 17:57:23.840941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 17:57:23.841211 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 17:57:23.842243 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 17:57:23.842527 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 17:57:23.842786 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 17:57:23.843150 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.843494 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.843832 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.844121 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.844462 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.844798 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.845119 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.845459 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.845800 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.846124 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.846442 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.846763 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.847024 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.847346 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] config_source = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.847675 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.848036 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.848295 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] debug = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.848612 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.849142 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.849463 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.849781 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.850112 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.850421 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.850732 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.851056 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.851424 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] host = dv-cinder-760194-3-iscsi {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.851739 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.852094 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.852424 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.852753 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.853066 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.853378 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.853705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.854014 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] log_dir = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.854388 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] log_file = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.854660 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.855247 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.855664 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.856030 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.856294 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.856549 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.856881 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.857213 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.857529 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.857843 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.858156 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.858468 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.858780 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.859085 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.859412 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.859742 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.860097 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.860414 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.860725 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.861033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.861341 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.861667 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.861979 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.862289 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.862599 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.862929 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.863232 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.863541 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.863917 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.864238 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.864565 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.864893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.865206 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.865537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.865845 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.866153 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] use_journal = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.866461 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] use_json = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.866769 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.867072 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.867395 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.867705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.868040 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.868354 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.868663 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.868993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:23.869327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.870179 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.870536 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.870856 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.871269 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.871595 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.871948 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.872268 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.872602 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.872937 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.873267 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.873584 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.873910 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.874224 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.874562 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.874911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.875250 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.875584 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.875913 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.876229 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.876539 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.876855 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.877178 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.877517 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.877848 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.878158 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.878472 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.878807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.879123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.879432 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.879746 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.880129 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.880446 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.880756 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.881076 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.881391 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.881698 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.882005 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.882318 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.882649 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.882961 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.883269 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.883575 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.883942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.884220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.884544 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.884856 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.885167 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.886029 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.886345 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.886729 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.887043 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.887360 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.887673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.888014 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.888327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.888639 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.888948 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.889256 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.889563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.889870 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.890175 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.890489 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.890798 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.891104 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.891410 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.891721 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.892059 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.892384 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.892719 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.893033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.893349 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.893665 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.893980 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.894294 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.894608 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.894924 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.895239 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.895547 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.895941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.896242 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.896565 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.896886 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.897204 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.897561 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.897858 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.898182 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.898498 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.898813 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.899137 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.899463 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.899796 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.900167 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.900493 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.900825 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.901180 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.901499 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.901852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.902184 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:23.902495 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 17:57:23.902755 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=84000) load_app /usr/local/lib/python3.6/dist-packages/oslo_service/wsgi.py:350}} Feb 17 17:57:24.560894 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO keyring.backend [-] Loading Gnome Feb 17 17:57:24.578953 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO keyring.backend [-] Loading Google Feb 17 17:57:24.581542 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO keyring.backend [-] Loading Windows (alt) Feb 17 17:57:24.585024 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO keyring.backend [-] Loading file Feb 17 17:57:24.586061 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO keyring.backend [-] Loading keyczar Feb 17 17:57:24.586344 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO keyring.backend [-] Loading multi Feb 17 17:57:24.586990 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO keyring.backend [-] Loading pyfs Feb 17 17:57:24.632551 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=84000) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:57:24.632876 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=84000) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:57:24.633205 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=84000) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:57:24.633580 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.manager [-] Loading core plugin: ml2 Feb 17 17:57:25.025895 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.026427 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.026548 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.076063 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.076375 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.076675 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.080280 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.080593 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.080892 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.149470 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.149784 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.150090 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.151788 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.152123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.152503 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.423851 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.424214 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.424510 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.424820 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.425648 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.573714 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.574171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.574514 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.574812 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.575110 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.575497 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.575798 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.576120 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.576412 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.576751 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.577047 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.577352 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.577661 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.577960 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.578273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.578595 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.578887 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.579211 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.579500 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.580022 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.580313 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.580596 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.580939 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.581221 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.581502 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.581927 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=84000) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:206}} Feb 17 17:57:25.582199 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=84000) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:206}} Feb 17 17:57:25.582474 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=84000) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:206}} Feb 17 17:57:25.582747 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=84000) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:206}} Feb 17 17:57:25.583020 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=84000) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:206}} Feb 17 17:57:25.583291 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=84000) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:206}} Feb 17 17:57:25.583715 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Feb 17 17:57:25.587042 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Feb 17 17:57:25.591087 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Feb 17 17:57:25.595008 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(600, 649)])]) Feb 17 17:57:25.596719 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Feb 17 17:57:25.597993 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Feb 17 17:57:25.598377 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vxlan'] Feb 17 17:57:25.598816 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Feb 17 17:57:25.601583 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Feb 17 17:57:25.601874 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Feb 17 17:57:25.602261 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch'] Feb 17 17:57:25.625121 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Feb 17 17:57:25.625640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.625976 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=84000) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:79}} Feb 17 17:57:25.626388 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.627732 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=84000) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Feb 17 17:57:25.628083 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch'] Feb 17 17:57:25.628364 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch'] Feb 17 17:57:25.631568 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.631910 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:25.697536 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Feb 17 17:57:25.697798 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Feb 17 17:57:25.698108 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Feb 17 17:57:25.698518 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Feb 17 17:57:25.732755 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_db.sqlalchemy.engines [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84000) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 17:57:26.249727 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Initializing driver for type 'gre' Feb 17 17:57:26.250269 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] gre ID ranges: [(1, 1000)] Feb 17 17:57:26.358294 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Initializing driver for type 'local' Feb 17 17:57:26.358671 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Initializing driver for type 'vlan' Feb 17 17:57:26.417498 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] VlanTypeDriver initialization complete Feb 17 17:57:26.417873 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Initializing driver for type 'vxlan' Feb 17 17:57:26.418422 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] vxlan ID ranges: [(1, 1000)] Feb 17 17:57:26.537591 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Initializing extension driver 'port_security' Feb 17 17:57:26.537899 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.extensions.port_security [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] PortSecurityExtensionDriver initialization complete Feb 17 17:57:26.538280 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Initializing mechanism driver 'openvswitch' Feb 17 17:57:26.544594 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=84000) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:57:26.545418 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > port after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.545824 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > port after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.546211 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > port after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.546637 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > subnet after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.547027 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > subnet after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.547408 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > subnet after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.547828 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > network after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.548241 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > network after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.548621 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > network after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.549033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > security_group after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.549411 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > security_group after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.549786 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > security_group after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.550199 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.550578 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.550951 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.551490 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > address_group after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.551920 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > address_group after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.552285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > address_group after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.552651 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] ML2 OVO RPC backend initialized. {{(pid=84000) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:141}} Feb 17 17:57:26.553367 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router_interface after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.553758 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.554220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > network before_response 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.554604 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > networks before_response 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.554984 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > port before_response 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.555361 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > ports before_response 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.555738 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > subnet before_response 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.556140 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > subnets before_response 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.556522 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > network after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.556899 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > network after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.557271 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > network after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.557641 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > port after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.558014 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > port after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.558384 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > port after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.558759 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > subnet after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.559133 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > subnet after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.559501 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > subnet after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.560163 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.plugin [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Modular L2 Plugin initialization complete Feb 17 17:57:26.560518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading services supported by the core plugin {{(pid=84000) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Feb 17 17:57:26.560883 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.plugins.ml2.managers [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Got port-security extension from driver 'port_security' Feb 17 17:57:26.561389 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.extensions.vlantransparent [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Disabled vlantransparent extension. Feb 17 17:57:26.561874 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=84000) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Feb 17 17:57:26.562219 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading Plugin: router Feb 17 17:57:26.600809 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router_interface before_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.601254 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router after_create 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.601665 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router before_create 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.602077 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.602497 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.602893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router after_delete 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.603297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > floatingip after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.603707 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router after_create 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.604476 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router after_update 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.604572 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router after_update 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.605186 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.605595 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router after_update 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.606082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router precommit_update 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.606501 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: port after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.606883 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: port after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.607259 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: subnet after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.607640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.608057 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > port precommit_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.608447 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router precommit_create 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.608834 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: port before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.609215 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router precommit_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.609620 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router after_update 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.610001 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router precommit_delete 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.610395 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router precommit_create 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.610803 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router_interface after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.611188 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router precommit_update 55549900 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.611618 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > network after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.612650 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Tracking information for resource: router configured {{(pid=84000) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:206}} Feb 17 17:57:26.613022 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Tracking information for resource: floatingip configured {{(pid=84000) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:206}} Feb 17 17:57:26.617841 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.l3_agentschedulers_db [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Feb 17 17:57:26.618483 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: port after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.618878 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: port after_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.619264 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: port after_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.619665 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: port after_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.620607 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router before_create 55550100 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.621084 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router precommit_delete 55550100 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.621495 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router precommit_create 55550100 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.621893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > router precommit_update 55550100 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.626611 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.provider_configuration [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service providers = [] {{(pid=84000) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Feb 17 17:57:26.627010 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.servicetype_db [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=84000) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Feb 17 17:57:26.630007 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.service_base [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=84000) load_drivers /opt/stack/neutron/neutron/services/service_base.py:52}} Feb 17 17:57:26.630395 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.service_base [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=84000) load_drivers /opt/stack/neutron/neutron/services/service_base.py:52}} Feb 17 17:57:26.630771 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.service_base [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=84000) load_drivers /opt/stack/neutron/neutron/services/service_base.py:52}} Feb 17 17:57:26.631655 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.service_base [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=84000) load_drivers /opt/stack/neutron/neutron/services/service_base.py:52}} Feb 17 17:57:26.632105 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.services.service_base [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Default provider is not specified for service type L3_ROUTER_NAT Feb 17 17:57:26.632525 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=84000) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:232}} Feb 17 17:57:26.632877 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Feb 17 17:57:26.643589 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=84000) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:232}} Feb 17 17:57:26.643987 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading Plugin: auto_allocate Feb 17 17:57:26.649807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: network precommit_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.650217 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: network precommit_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.650801 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=84000) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:232}} Feb 17 17:57:26.651696 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading Plugin: tag Feb 17 17:57:26.658920 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=84000) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:232}} Feb 17 17:57:26.659283 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading Plugin: timestamp Feb 17 17:57:26.663129 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=84000) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:232}} Feb 17 17:57:26.663652 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading Plugin: network_ip_availability Feb 17 17:57:26.669190 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.669595 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.669982 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.670770 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=84000) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:232}} Feb 17 17:57:26.671125 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading Plugin: flavors Feb 17 17:57:26.675792 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=84000) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:232}} Feb 17 17:57:26.676187 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading Plugin: revisions Feb 17 17:57:26.680434 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=84000) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:232}} Feb 17 17:57:26.680860 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 2.048s {{(pid=84000) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:57:26.681666 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=84000) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}} Feb 17 17:57:26.682029 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Initializing extension manager. Feb 17 17:57:26.683105 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: __init__.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.683482 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: __pycache__ {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.683854 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.684332 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: address_group.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.685292 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.685945 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: address-group Feb 17 17:57:26.686311 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: address_scope.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.687080 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.687662 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: address-scope Feb 17 17:57:26.688064 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: admin_state_down_before_update.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.689005 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.689587 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: router-admin-state-down-before-update Feb 17 17:57:26.689947 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: agent.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.690707 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.691285 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: agent Feb 17 17:57:26.691645 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: agent_resources_synced.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.692612 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.693187 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: agent-resources-synced Feb 17 17:57:26.693546 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: allowedaddresspairs.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.695332 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.695966 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: allowed-address-pairs Feb 17 17:57:26.696338 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: auto_allocated_topology.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.697414 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.698587 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: auto-allocated-topology Feb 17 17:57:26.698948 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: availability_zone.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.699700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.700313 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: availability_zone Feb 17 17:57:26.700677 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: availability_zone_filter.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.701612 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.702195 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: availability_zone_filter Feb 17 17:57:26.702553 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: data_plane_status.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.703479 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.704180 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension data-plane-status not supported by any of loaded plugins Feb 17 17:57:26.704543 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: default_subnetpools.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.705470 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.706051 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: default-subnetpools Feb 17 17:57:26.706414 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: dhcpagentscheduler.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.707376 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.708008 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: dhcp_agent_scheduler Feb 17 17:57:26.708377 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: dns.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.709310 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.709884 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension dns-integration not supported by any of loaded plugins Feb 17 17:57:26.710245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: dns_domain_ports.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.711169 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.711743 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension dns-domain-ports not supported by any of loaded plugins Feb 17 17:57:26.712130 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: dvr.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.712858 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.713468 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: dvr Feb 17 17:57:26.713829 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: empty_string_filtering.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.714823 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.715404 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: empty-string-filtering Feb 17 17:57:26.715763 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.716703 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.717278 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Feb 17 17:57:26.717636 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.718563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.719140 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Feb 17 17:57:26.719501 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: external_net.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.720446 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.721027 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: external-net Feb 17 17:57:26.721388 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: extra_dhcp_opt.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.722309 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.722883 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: extra_dhcp_opt Feb 17 17:57:26.723242 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: extraroute.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.724257 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.724838 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: extraroute Feb 17 17:57:26.725197 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: extraroute_atomic.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.726220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.726799 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: extraroute-atomic Feb 17 17:57:26.727157 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: filter_validation.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.727856 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.728484 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: filter-validation Feb 17 17:57:26.728844 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: fip_pf_description.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.729784 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.730635 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Feb 17 17:57:26.731052 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: fip_port_details.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.732007 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.732594 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: fip-port-details Feb 17 17:57:26.732951 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: flavors.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.734181 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.734765 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: flavors Feb 17 17:57:26.735128 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.736799 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.737395 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Feb 17 17:57:26.737859 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: floatingip_pools.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.738616 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.739201 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: floatingip-pools Feb 17 17:57:26.739567 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: ip_allocation.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.740553 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.741132 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension ip_allocation not supported by any of loaded plugins Feb 17 17:57:26.741498 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.742426 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.743007 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: ip-substring-filtering Feb 17 17:57:26.743370 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: l2_adjacency.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.744332 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.745435 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension l2_adjacency not supported by any of loaded plugins Feb 17 17:57:26.745795 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: l3.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.746859 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.747452 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: router Feb 17 17:57:26.747818 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: l3_conntrack_helper.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.750072 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.750672 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Feb 17 17:57:26.751046 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.752018 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.752610 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: ext-gw-mode Feb 17 17:57:26.752981 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.753913 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.754498 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: l3-ha Feb 17 17:57:26.754864 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: l3_flavors.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.755789 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.756585 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: l3-flavors Feb 17 17:57:26.756845 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.757770 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.758352 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: l3-port-ip-change-not-allowed Feb 17 17:57:26.758708 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: l3agentscheduler.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.760002 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.761201 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: l3_agent_scheduler Feb 17 17:57:26.761567 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: logging.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.763074 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.763669 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension logging not supported by any of loaded plugins Feb 17 17:57:26.764070 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: metering.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.764869 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.765572 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: metering Feb 17 17:57:26.765938 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.767057 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.767641 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: metering_source_and_destination_fields Feb 17 17:57:26.768040 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: multiprovidernet.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.768969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.769552 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: multi-provider Feb 17 17:57:26.769916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: netmtu.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.770851 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.771433 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: net-mtu Feb 17 17:57:26.771792 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: netmtu_writable.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.772758 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.773337 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: net-mtu-writable Feb 17 17:57:26.773724 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: network_availability_zone.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.774416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.774996 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: network_availability_zone Feb 17 17:57:26.775357 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: network_ip_availability.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.776507 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.777108 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: network-ip-availability Feb 17 17:57:26.777512 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: network_segment_range.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.778448 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.779030 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension network-segment-range not supported by any of loaded plugins Feb 17 17:57:26.779390 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: pagination.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.780435 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.780809 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: pagination Feb 17 17:57:26.781168 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: port_device_profile.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.782084 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.782675 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: port-device-profile Feb 17 17:57:26.783038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.784007 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.784592 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: port-mac-address-regenerate Feb 17 17:57:26.784949 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.785865 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.786448 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: port-numa-affinity-policy Feb 17 17:57:26.786807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: port_resource_request.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.787767 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.788338 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension port-resource-request not supported by any of loaded plugins Feb 17 17:57:26.788701 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: portbindings.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.789639 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.790221 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: binding Feb 17 17:57:26.790582 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: portbindings_extended.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.791918 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.792488 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: binding-extended Feb 17 17:57:26.792929 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: portsecurity.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.793855 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.794443 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: port-security Feb 17 17:57:26.794807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: project_id.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.795780 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.796190 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: project-id Feb 17 17:57:26.796556 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: providernet.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.797478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.798065 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: provider Feb 17 17:57:26.798424 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: qos.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.801993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.802596 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension qos not supported by any of loaded plugins Feb 17 17:57:26.802970 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.805475 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.806077 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Feb 17 17:57:26.806444 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.807914 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.808578 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Feb 17 17:57:26.808948 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: qos_default.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.809871 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.810445 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension qos-default not supported by any of loaded plugins Feb 17 17:57:26.810807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: qos_fip.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.811497 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.812094 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension qos-fip not supported by any of loaded plugins Feb 17 17:57:26.812457 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: qos_gateway_ip.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.813392 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.813968 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension qos-gateway-ip not supported by any of loaded plugins Feb 17 17:57:26.814330 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: qos_port_network_policy.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.815310 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.815966 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension qos-port-network-policy not supported by any of loaded plugins Feb 17 17:57:26.816331 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: qos_rule_type_details.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.817349 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.817921 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension qos-rule-type-details not supported by any of loaded plugins Feb 17 17:57:26.818279 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: qos_rules_alias.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.819333 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.819943 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension qos-rules-alias not supported by any of loaded plugins Feb 17 17:57:26.820311 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: quotasv2.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.821318 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.821687 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: quotas Feb 17 17:57:26.822043 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: quotasv2_detail.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.824312 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.824696 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: quota_details Feb 17 17:57:26.825062 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: rbac.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.826227 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.826825 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: rbac-policies Feb 17 17:57:26.827192 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: rbac_address_scope.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.828154 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.828743 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: rbac-address-scope Feb 17 17:57:26.829103 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: rbac_security_groups.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.830132 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.830720 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: rbac-security-groups Feb 17 17:57:26.831082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: rbac_subnetpool.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.832033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.832621 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: rbac-subnetpool Feb 17 17:57:26.832981 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: revisionifmatch.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.833919 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.834504 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: revision-if-match Feb 17 17:57:26.834870 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: revisions.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.836026 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.836610 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: standard-attr-revisions Feb 17 17:57:26.836972 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: router_availability_zone.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.837688 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.838274 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: router_availability_zone Feb 17 17:57:26.839227 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: routerservicetype.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.840252 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.840847 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension router-service-type not supported by any of loaded plugins Feb 17 17:57:26.841212 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.842147 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.842740 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: security-groups-normalized-cidr Feb 17 17:57:26.843103 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: security_groups_port_filtering.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.844100 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.844683 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: port-security-groups-filtering Feb 17 17:57:26.845044 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.846029 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.846620 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: security-groups-remote-address-group Feb 17 17:57:26.846986 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: securitygroup.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.861075 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.861697 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: security-group Feb 17 17:57:26.862072 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: segment.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.862931 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.863522 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension segment not supported by any of loaded plugins Feb 17 17:57:26.863908 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.864875 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.865457 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Feb 17 17:57:26.865819 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: servicetype.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.866925 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.867517 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: service-type Feb 17 17:57:26.867909 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: sorting.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.868891 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.869267 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: sorting Feb 17 17:57:26.869652 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: standard_attr_segment.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.870574 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.871238 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension standard-attr-segment not supported by any of loaded plugins Feb 17 17:57:26.871681 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: standardattrdescription.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.872397 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.872978 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: standard-attr-description Feb 17 17:57:26.873340 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: stateful_security_group.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.874294 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.874888 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: stateful-security-group Feb 17 17:57:26.875240 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: stdattrs_common.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.875840 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Feb 17 17:57:26.876234 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.877247 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.877839 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Feb 17 17:57:26.878201 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: subnet_onboard.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.879286 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.879907 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: subnet_onboard Feb 17 17:57:26.880259 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.881192 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.881774 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Feb 17 17:57:26.882132 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: subnet_service_types.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.883073 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.883666 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: subnet-service-types Feb 17 17:57:26.884056 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: subnetallocation.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.885134 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.885746 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: subnet_allocation Feb 17 17:57:26.886113 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.886813 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.887398 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: subnetpool-prefix-ops Feb 17 17:57:26.887759 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.888727 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.889305 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Feb 17 17:57:26.889664 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: tagging.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.890938 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, router, floatingip, policy, security_group, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.891529 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: standard-attr-tag Feb 17 17:57:26.891927 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: timestamp.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.893110 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.893707 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loaded extension: standard-attr-timestamp Feb 17 17:57:26.894071 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: trunk.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.895097 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.895688 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension trunk not supported by any of loaded plugins Feb 17 17:57:26.896076 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: trunk_details.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.897008 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.897585 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension trunk-details not supported by any of loaded plugins Feb 17 17:57:26.897945 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: uplink_status_propagation.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.898876 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.899448 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension uplink-status-propagation not supported by any of loaded plugins Feb 17 17:57:26.899809 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Loading extension file: vlantransparent.py {{(pid=84000) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Feb 17 17:57:26.900539 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=84000) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 17 17:57:26.901630 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extension vlan-transparent not supported by any of loaded plugins Feb 17 17:57:26.904452 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:network Feb 17 17:57:26.905272 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:subnet Feb 17 17:57:26.905943 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:subnetpool Feb 17 17:57:26.906603 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:port Feb 17 17:57:26.908110 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.908602 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service FLAVORS assigned prefix: {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.909309 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.909783 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.910149 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:router Feb 17 17:57:26.910873 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:floatingip Feb 17 17:57:26.911657 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service METERING assigned prefix: /metering {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.913488 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.913892 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.914277 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=84000) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 17:57:26.915444 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of CountableResource for resource:rbac_policy Feb 17 17:57:26.915962 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:security_group Feb 17 17:57:26.917389 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:security_group_rule Feb 17 17:57:26.918295 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service CORE assigned prefix: {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.918659 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:subnetpool Feb 17 17:57:26.919033 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] subnetpool is already registered Feb 17 17:57:26.919703 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service CORE assigned prefix: {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.920096 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:subnetpool Feb 17 17:57:26.920457 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] subnetpool is already registered Feb 17 17:57:26.923233 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.923716 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service FLAVORS assigned prefix: {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.924425 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.924895 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.925266 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:router Feb 17 17:57:26.925632 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] router is already registered Feb 17 17:57:26.926296 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:floatingip Feb 17 17:57:26.926658 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] floatingip is already registered Feb 17 17:57:26.927362 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service METERING assigned prefix: /metering {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.928138 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of CountableResource for resource:rbac_policy Feb 17 17:57:26.928505 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] rbac_policy is already registered Feb 17 17:57:26.929132 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:security_group Feb 17 17:57:26.929497 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] security_group is already registered Feb 17 17:57:26.930159 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:security_group_rule Feb 17 17:57:26.930523 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] security_group_rule is already registered Feb 17 17:57:26.931262 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service CORE assigned prefix: {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.931638 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:subnetpool Feb 17 17:57:26.932026 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] subnetpool is already registered Feb 17 17:57:26.932730 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.resource_helper [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Service CORE assigned prefix: {{(pid=84000) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:78}} Feb 17 17:57:26.933097 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Creating instance of TrackedResource for resource:subnetpool Feb 17 17:57:26.933544 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING neutron.quota.resource_registry [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] subnetpool is already registered Feb 17 17:57:26.934269 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: extensions {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.935826 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: address-groups {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.937553 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: address-scopes {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.938867 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: agents {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.940126 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: auto-allocated-topology {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.941459 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: availability_zones {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.943121 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: dhcp-networks {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.944671 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: dhcp-agents {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.946182 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: routers {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.948156 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: flavors {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.949415 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: service_profiles {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.950711 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: next_providers {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.953257 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: service_profiles {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.954852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: floatingip-pools {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.956194 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: routers {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.958115 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: floatingips {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.959379 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: l3-routers {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.960904 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: l3-agents {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.962421 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: metering-labels {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.964439 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: metering-label-rules {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.965820 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: network-ip-availabilities {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.967181 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: bindings {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.968998 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: quotas {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.970522 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: quotas {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.972075 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: rbac-policies {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.973468 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: security-groups {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.974752 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: security-group-rules {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.976100 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: service-providers {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.977405 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: subnetpools {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.978945 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: subnetpools {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.981410 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: tags {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.983194 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: tags {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.985146 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: tags {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.987051 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: tags {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.989041 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: tags {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.990846 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: tags {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.992802 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: tags {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.994791 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: tags {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.996881 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: tags {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:26.998847 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.extensions [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Extended resource: tags {{(pid=84000) __init__ /opt/stack/neutron/neutron/api/extensions.py:158}} Feb 17 17:57:27.005925 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING keystonemiddleware.auth_token [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 17:57:27.011852 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING keystonemiddleware.auth_token [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 17:57:27.020746 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Acquired lock "singleton_lock" {{(pid=84000) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 17:57:27.021275 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Releasing lock "singleton_lock" {{(pid=84000) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 17:57:27.022710 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO oslo_service.service [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Starting 2 workers Feb 17 17:57:27.028273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Started child 84111 {{(pid=84000) _start_child /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:576}} Feb 17 17:57:27.032341 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:27.033161 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Started child 84112 {{(pid=84000) _start_child /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:576}} Feb 17 17:57:27.033834 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [-] (84111) wsgi starting up on http://0.0.0.0:9696 Feb 17 17:57:27.034662 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.service [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Neutron service started, listening on 0.0.0.0:9696 Feb 17 17:57:27.035363 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Notify callbacks [] for process, before_spawn {{(pid=84000) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:27.036666 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:27.038021 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO oslo_service.service [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Starting 1 workers Feb 17 17:57:27.038197 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [-] (84112) wsgi starting up on http://0.0.0.0:9696 Feb 17 17:57:27.043643 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Started child 84113 {{(pid=84000) _start_child /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:576}} Feb 17 17:57:27.044266 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO oslo_service.service [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Starting 1 workers Feb 17 17:57:27.045672 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.service [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] calling RpcWorker wait() {{(pid=84113) _wait /opt/stack/neutron/neutron/service.py:128}} Feb 17 17:57:27.046063 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.service [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] returning from RpcWorker wait() {{(pid=84113) _wait /opt/stack/neutron/neutron/service.py:135}} Feb 17 17:57:27.047625 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:27.048170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:57:27.049232 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Started child 84114 {{(pid=84000) _start_child /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:576}} Feb 17 17:57:27.050080 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-84c04c2a-8ea3-4f16-a1f8-1f79c659c9e7 None None] Notify callbacks [] for process, after_spawn {{(pid=84000) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:27.051803 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=84000) wait /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:650}} Feb 17 17:57:27.052130 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 17:57:27.052269 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 17:57:27.052721 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 17:57:27.053129 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 17:57:27.053229 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:27.053309 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 17:57:27.053861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.054178 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.054376 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:57:27.054472 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.054756 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.055101 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.055808 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.056156 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.056472 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.056788 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.057108 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.057417 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.057691 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.058028 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.058333 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.058683 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.058973 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.059265 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.059537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.059753 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.060085 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] config_source = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.060384 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.060675 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.060978 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] debug = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.061265 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.061836 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.062096 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.062400 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.062674 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.062965 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.063251 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.063548 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.063836 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.064109 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.064360 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.064642 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.064904 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.065179 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.065468 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.065726 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.066189 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] host = dv-cinder-760194-3-iscsi {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.066441 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.066693 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.066962 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.067227 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.067509 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.067771 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.068087 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.068386 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.068646 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.068927 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.069199 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.069473 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.069717 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_dir = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.069980 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_file = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.070171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_options = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.070438 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.070744 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.071086 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.071242 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.071393 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.071540 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.071906 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.072067 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.072325 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.072611 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.073354 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.073619 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.073865 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.074296 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.074533 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.074786 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.075066 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.075326 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.075618 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.075943 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.076231 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.076496 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.076764 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.077030 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.077278 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.078302 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.078600 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.078884 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.079160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.079465 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.079755 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.080085 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.080355 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.080655 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.080966 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.081221 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.081486 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.081823 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.082103 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.082395 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.082686 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.082942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.083216 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.083491 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.083749 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] use_journal = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.084044 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] use_json = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.084299 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.084562 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.084846 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.085097 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.085362 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.085612 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.085882 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.086171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.086619 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.086932 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.087291 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.087550 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.087821 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.088123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.089045 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.089272 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.089877 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.089877 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.101700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.101700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.101700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.101700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.101700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.101700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.101700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.101700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.102705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.102705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.102705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.102705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.102705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.102705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.102705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.13/identity {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.102705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.103398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.103398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.103398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.103398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.103398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.103398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.103398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.103398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.103398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.104506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.104506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.104506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.104506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.104506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.104506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.104506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.104506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.104506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.105954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.105954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.105954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.105954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.105954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.105954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.105954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.105954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.105954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.107058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.107058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.107058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.107058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.107058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.107058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.107058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.107058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.107058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.108297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.108297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.108297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.108297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.108297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.108297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.108297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.108297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.108297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.109339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.109339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.109339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.109339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.109339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.109339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.109339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.109339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.109339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.110285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.110285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.110285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.110285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.110285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.110285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.110285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.110285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.111123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.111123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.111123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.111123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.111123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.111123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.111123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.111123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.111848 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.111848 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.111848 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.112110 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.112261 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.112515 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.112790 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.113051 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.113327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.113593 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.113894 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.114191 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.114577 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.114884 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.115201 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.115530 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.115788 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.116126 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.116383 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.116675 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.117020 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.117346 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.117650 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.117941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.118224 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.118551 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.118799 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.119101 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.119380 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.119693 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.120000 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.120322 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.120632 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.120878 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.121103 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.121554 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.122124 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.122452 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.122715 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.122979 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.123934 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.123934 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.124302 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.124525 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.124884 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.125167 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.125463 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.125757 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.13/identity {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.126012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.126766 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.126766 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.126766 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.127216 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.127216 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.128062 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.128062 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.128062 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.128258 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.128470 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.128711 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.128969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.129222 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.129482 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.129775 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.130339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.130339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.130656 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.130841 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.131016 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.131167 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.131419 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.131708 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.131984 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.132300 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.132596 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.132865 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.133151 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.133435 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.133722 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.133972 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.134259 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.134517 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.134769 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.135031 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.135774 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.136050 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.136317 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.136596 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.136839 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.137117 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.137371 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.137743 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.138016 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.138286 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.138561 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.138814 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.139085 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.139342 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.139599 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.139854 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.140136 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.140391 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.140671 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.140947 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.141220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.141468 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.141713 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.141959 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.142228 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.142471 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.142824 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.143102 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.143362 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.143623 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.143898 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.144180 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.144443 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.144688 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.144942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.145192 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.145452 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.145999 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.145999 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.146176 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.146374 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.146701 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.146991 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.147265 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.147584 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.147861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.148175 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.148453 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.148819 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.149069 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.149347 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.149603 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.150339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.150339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.150502 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vxlan'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.150830 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.151691 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.152038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.152354 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.152711 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.152989 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:600:649'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.153309 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.153564 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.153876 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.154247 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.154533 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.154842 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.155113 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.155422 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.155764 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.156063 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.156322 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.156578 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.156837 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.157120 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.157408 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.157674 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.157929 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.158224 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.158477 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.158739 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.158990 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.159247 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.159499 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.159686 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 17:57:27.160273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=84000) wait /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:650}} Feb 17 17:57:27.160465 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 17:57:27.160647 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 17:57:27.160871 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 17:57:27.161048 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 17:57:27.161203 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 17:57:27.161456 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.161648 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.161811 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.161971 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.162157 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.162381 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.162573 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.162760 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.162949 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.163137 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.163323 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.163504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.163655 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.163812 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.164010 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.164195 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.164380 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.164565 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.164755 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.164940 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] config_source = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.165127 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.165313 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.165499 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] debug = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.165683 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.165903 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.166089 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.166275 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.166480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.166666 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.166852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.167035 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.167220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.167405 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.167591 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.167777 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.168000 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.168186 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.168563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.168563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.168764 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] host = dv-cinder-760194-3-iscsi {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.168861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.168999 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.169184 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.169367 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.169590 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.169689 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.169874 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.170012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.170183 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.170367 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.170552 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.170736 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.170941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_dir = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.171211 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_file = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.171211 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_options = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.171394 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.171567 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.171752 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.171987 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.172161 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.172345 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.172562 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.172754 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.172946 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.173113 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.174416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.174416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.174416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.174416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.174416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.174416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.174416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.174416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.175114 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.175114 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.175114 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.175114 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.175480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.175480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.175480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.175749 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.175843 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.175998 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.176183 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.176367 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.176551 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.176737 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.176922 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.177108 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.177292 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.177478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.177665 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.177852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.178037 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.178219 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.178460 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.178577 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.178727 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.178911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.179096 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] use_journal = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.179279 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] use_json = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.179463 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.179646 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.179832 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.180050 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.180230 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.180379 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.180563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.180748 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 17:57:27.180954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.181217 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.181426 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.181620 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.181806 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.181996 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.182208 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.182397 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.182583 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.182771 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.182972 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.183160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.183368 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.183576 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.183724 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.183933 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.184125 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.184313 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.184504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.184693 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.184881 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.185070 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.185280 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.185467 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.185656 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.13/identity {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.185844 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.186034 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.186225 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.186418 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.186607 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.186771 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.186960 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.187147 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.187333 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.187520 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.187707 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.187928 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.188106 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.188306 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.188484 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.188673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.188861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.189048 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.189236 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.189423 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.189611 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.189799 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.189986 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.190176 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.190363 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.190563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.190750 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.190936 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.191125 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.191314 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.191501 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.191688 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.191884 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.192083 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.192272 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.192460 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.192663 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.192850 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.193036 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.193226 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.193415 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.193607 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.193795 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.193984 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.194170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.194357 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.194543 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.194730 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.194918 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.195105 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.195292 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.195478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.195667 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.195854 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.196062 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.196249 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.196436 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.196607 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.196782 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.196976 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.197181 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.197367 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.197554 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.198260 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.198448 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.198634 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.198821 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.199009 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.199195 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.199382 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.199568 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.199756 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.199970 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.200158 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.200347 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.200533 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.200719 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.200904 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.201090 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.201277 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.201463 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.201650 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.201839 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.202025 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.202212 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.202400 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.202598 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.202786 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.202976 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.203162 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.203356 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.203555 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.203758 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.203992 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.204153 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.204342 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.204533 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.204721 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.204909 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.205096 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.205285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.205471 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.205667 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.205868 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.206054 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.206241 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.206427 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.206663 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.206851 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.207037 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.207225 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.207412 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.207600 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.207787 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.207999 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.208190 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.208378 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.208566 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.208755 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.13/identity {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.208942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.209133 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.209318 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.209508 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.209697 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.209885 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.210073 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.210262 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.210451 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.210639 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.210826 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.211011 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.211197 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.211387 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.211573 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.211762 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.211985 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.212178 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.212367 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.212553 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.212739 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.212925 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.213115 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.213328 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.214067 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.214238 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.214427 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.214616 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.214805 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.214993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.215182 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.215404 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.215594 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.215781 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.215995 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.216186 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.216378 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.216567 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.216756 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.216942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.217131 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.217318 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.217506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.217709 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.217896 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.218081 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.218270 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.218456 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.218643 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.218830 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.219019 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.219204 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.219392 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.219577 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.219765 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.219980 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.220169 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.220355 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.220542 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.220729 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.220916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.221102 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.221302 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.221488 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.221675 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.221863 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.222050 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.222246 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.222433 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.222619 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.222806 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.222992 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.223189 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.223375 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.223561 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.223747 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.223957 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.224162 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.224351 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.224542 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.224863 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.225046 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.225234 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.225421 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.225621 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.225809 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.225999 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.226186 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.226373 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.226563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.226751 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vxlan'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.226945 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.227141 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.227335 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.227524 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.227719 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.227938 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:600:649'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.228141 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.228328 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.228522 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.228723 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.228953 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.229151 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.229340 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.229526 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.229713 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.229901 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.230351 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.230538 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.230725 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.231036 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.231227 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.231415 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.231602 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.231788 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.232001 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.232188 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.232375 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.232564 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.232753 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 17:57:27.232934 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=84000) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 17:57:27.235407 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:57:27.276480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 51350) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:57:27.284575 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [-] 10.222.0.13 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0107739 Feb 17 17:57:37.750976 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2f19706-04f3-4824-8b12-37c646044922 None None] get_active_networks_info from dv-cinder-760194-3-iscsi {{(pid=84113) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Feb 17 17:57:37.912755 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2f19706-04f3-4824-8b12-37c646044922 None None] No non-hosted networks {{(pid=84113) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Feb 17 17:57:37.935712 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agentschedulers_db [None req-d2f19706-04f3-4824-8b12-37c646044922 None None] DHCP Agent not found on host dv-cinder-760194-3-iscsi {{(pid=84113) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:447}} Feb 17 17:57:38.174824 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-855c71f8-31dc-4a54-b44b-cf11dd690c11 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590'] for agent, after_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:39.821332 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1bafe266-c649-4480-aa7f-875d953f4004 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590'] for agent, after_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:39.907230 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-68f61db8-b052-4cb3-9ce0-388150895cd7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:40.852203 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590'] for agent, after_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:41.987284 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590'] for agent, after_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:41.988959 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:41.989623 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:41.990292 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:41.990846 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:41.991534 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:41.992109 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:41.992670 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:41.993242 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:41.993814 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:41.994386 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:41.994939 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:41.995536 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:41.998626 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-760194-3-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.1'}) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:57:42.016250 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-760194-3-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.1'}} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:57:42.320218 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.l3_hamode_db [None req-9b1b805a-9b35-4eb1-99f0-cf8e3fd53865 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Feb 17 17:57:42.419987 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b1b805a-9b35-4eb1-99f0-cf8e3fd53865 None None] Routers set() bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 17:57:42.420797 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b1b805a-9b35-4eb1-99f0-cf8e3fd53865 None None] Router IDs set() for agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}} Feb 17 17:57:42.737808 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590'] for agent, after_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:43.835918 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 51440) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:57:43.960477 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] get_endpoint_by_host() called for host dv-cinder-760194-3-iscsi {{(pid=84113) get_endpoint_by_host /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:347}} Feb 17 17:57:43.965863 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] get_endpoint_by_ip() called for ip 192.168.0.58 {{(pid=84113) get_endpoint_by_ip /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:353}} Feb 17 17:57:43.969120 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] _add_endpoint() called for ip 192.168.0.58 {{(pid=84113) _add_endpoint /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:377}} Feb 17 17:57:44.000355 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] _get_endpoints() called {{(pid=84113) _get_endpoints /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:372}} Feb 17 17:57:44.466145 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING oslo_policy.policy [None req-0aae755c-e92e-4e7e-94be-d4dbae6e2864 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 17 17:57:44.466768 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING oslo_policy.policy [None req-0aae755c-e92e-4e7e-94be-d4dbae6e2864 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 17 17:57:44.696734 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [None req-0aae755c-e92e-4e7e-94be-d4dbae6e2864 admin admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=84112) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 17 17:57:44.698358 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-0aae755c-e92e-4e7e-94be-d4dbae6e2864 admin admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13455 time: 0.8615038 Feb 17 17:57:47.389015 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 51456) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:57:47.781076 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-c7bdc5b0-8374-4361-af10-e34089cd4786 admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'shared': True, 'is_default': True}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 17:57:47.850402 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.policy [None req-c7bdc5b0-8374-4361-af10-e34089cd4786 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=84112) register_rules /opt/stack/neutron/neutron/policy.py:75}} Feb 17 17:57:47.887584 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING oslo_policy.policy [None req-c7bdc5b0-8374-4361-af10-e34089cd4786 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 17 17:57:47.888017 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING oslo_policy.policy [None req-c7bdc5b0-8374-4361-af10-e34089cd4786 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 17 17:57:47.914558 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota [None req-c7bdc5b0-8374-4361-af10-e34089cd4786 admin admin] Loaded quota_driver: . Feb 17 17:57:47.931076 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c7bdc5b0-8374-4361-af10-e34089cd4786 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 17:57:48.024231 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c7bdc5b0-8374-4361-af10-e34089cd4786 admin admin] Notify callbacks ['neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change--9223363306800139893', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change--9223363306800121653', 'neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change--9223363306800120796', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change--9223363306800110916', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change--9223363306800103741', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1518500', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1509151', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-588904', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-607475'] for rbac-policy, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:48.246350 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c7bdc5b0-8374-4361-af10-e34089cd4786 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:48.247588 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c7bdc5b0-8374-4361-af10-e34089cd4786 admin admin] 10.222.0.13 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.8575499 Feb 17 17:57:51.175471 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 51470) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:57:51.551601 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Request body: {'network': {'project_id': '1219ec43351448b5b60b9c9397391f95', 'admin_state_up': True, 'name': 'private'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 17:57:51.558129 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 17:57:51.562798 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Usage tracker for resource:network and tenant:1219ec43351448b5b60b9c9397391f95 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 17:57:51.566505 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 17:57:51.573458 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 17:57:51.615051 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Made reservation on behalf of 1219ec43351448b5b60b9c9397391f95 for: {'network': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 17:57:51.621749 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:51.640939 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:51.811272 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 17:57:51.815116 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Usage tracker for resource:security_group_rule and tenant:1219ec43351448b5b60b9c9397391f95 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 17:57:51.818817 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 17:57:51.824704 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 17:57:52.024720 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:52.051557 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:52.057665 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:57:52.076664 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] vxlan segment allocate from pool success with {'vxlan_vni': 1} {{(pid=84112) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:151}} Feb 17 17:57:52.102144 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment--9223363306798059772', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:52.102624 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Added segment 7a6f2c3b-61cf-4267-a8d2-bb6769336d23 of type vxlan for network 7f6a9784-1806-4e7c-a274-a93f7a9ae71e Feb 17 17:57:52.158343 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3dd5f191-80cf-41b8-9bbe-caea92db7e77,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:57:52.182043 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:52.182522 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:52.183071 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:52.183206 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:52.183528 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:52.183905 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:52.184269 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:52.184624 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:52.184978 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:52.185326 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:52.185674 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:52.186019 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Tracked resource versions report: Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: pushed versions: Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: { 'AddressGroup': {'1.1'}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': {'1.0'}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': {'1.0'}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': {'1.1'}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': {'1.7'}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': {'1.2'}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': {'1.8'}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': {'1.4'}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': {'1.2'}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': {'1.0'}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': {'1.1'}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': {'1.1'}} Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: consumer versions: Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: { DHCP agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: L3 agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: Metadata agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: Metering agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: Open vSwitch agent@dv-cinder-760194-3-iscsi: { 'AddressGroup': '1.1', Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': '1.0', Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': '1.0', Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': '1.1', Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': '1.7', Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': '1.2', Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': '1.8', Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': '1.4', Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': '1.2', Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': '1.0', Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': '1.1', Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': '1.1'}} Feb 17 17:57:52.187146 dv-cinder-760194-3-iscsi neutron-server[84000]: {{(pid=84112) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Feb 17 17:57:52.220522 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:52.238787 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:57:52.285845 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:52.287555 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 17:57:52.288245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:52.293722 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:57:52.405187 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Pushing event updated for resources: {'Network': ['ID=7f6a9784-1806-4e7c-a274-a93f7a9ae71e,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:57:52.408398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:57:52.416941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network 7f6a9784-1806-4e7c-a274-a93f7a9ae71e details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 17:57:52.441254 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 842 time: 1.2646012 Feb 17 17:57:55.475497 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 51486) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:57:55.953346 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dd547ef-c1f9-4eb1-8332-d6f9f40977b3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 17:57:55.954798 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-1dd547ef-c1f9-4eb1-8332-d6f9f40977b3 admin admin] 10.222.0.13 "GET /v2.0/networks/7f6a9784-1806-4e7c-a274-a93f7a9ae71e HTTP/1.1" status: 200 len: 818 time: 0.4782200 Feb 17 17:57:55.985886 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-4eb498b0-7b99-4b67-8191-99055ba31593 admin admin] 10.222.0.13 "GET /v2.0/subnetpools/1f90ea06-1591-4b97-a03b-8a78dd08349e HTTP/1.1" status: 200 len: 734 time: 0.0249259 Feb 17 17:57:55.995756 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Request body: {'subnet': {'ip_version': 4, 'gateway_ip': '172.20.0.1', 'name': 'private-subnet', 'subnetpool_id': '1f90ea06-1591-4b97-a03b-8a78dd08349e', 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e', 'tenant_id': '1219ec43351448b5b60b9c9397391f95'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 17:57:56.000160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 17:57:56.004033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Usage tracker for resource:subnet and tenant:1219ec43351448b5b60b9c9397391f95 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 17:57:56.006929 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 17:57:56.013100 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 17:57:56.108668 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Made reservation on behalf of 1219ec43351448b5b60b9c9397391f95 for: {'subnet': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 17:57:56.113148 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Notify callbacks [] for subnet, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:56.620719 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for subnet, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:56.635360 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:57:56.767412 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Pushing event updated for resources: {'Subnet': ['ID=5f24c70f-8bec-4c96-afa0-e740139099e4,revision_number=0']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:57:56.774107 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:57:56.837953 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Checking segment: {'id': '7a6f2c3b-61cf-4267-a8d2-bb6769336d23', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 1, 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 17:57:56.838334 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Network hostable DHCP agents. Network: 7f6a9784-1806-4e7c-a274-a93f7a9ae71e, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84112) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 17:57:56.897476 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Network 7f6a9784-1806-4e7c-a274-a93f7a9ae71e is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84112) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 17:57:56.932381 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, 7f6a9784-1806-4e7c-a274-a93f7a9ae71e) {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 17:57:56.936841 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 17:57:56.942710 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:56.943399 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1bb74b8-88cd-46e5-b5b1-42af0730302e None None] Network 7f6a9784-1806-4e7c-a274-a93f7a9ae71e requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 17:57:56.990079 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.9983451 Feb 17 17:57:57.443010 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa801fd4f-d9d9-59b5-9186-1ec4edf3a9c6-7f6a9784-1806-4e7c-a274-a93f7a9ae71e', 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'fixed_ips': [{'subnet_id': '5f24c70f-8bec-4c96-afa0-e740139099e4'}]}} from dv-cinder-760194-3-iscsi. {{(pid=84113) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Feb 17 17:57:57.444100 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:57.765011 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Allocated IP 172.20.0.2 (7f6a9784-1806-4e7c-a274-a93f7a9ae71e/5f24c70f-8bec-4c96-afa0-e740139099e4/6b45b530-2619-4e6c-90bf-4b64cc44babb) {{(pid=84113) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 17:57:58.000915 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Notify callbacks [] for port, precommit_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:58.095092 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Transition to ACTIVE for port object 6b45b530-2619-4e6c-90bf-4b64cc44babb will not be triggered until provisioned by entity L2. {{(pid=84113) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 17:57:58.113746 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Transition to ACTIVE for port object 6b45b530-2619-4e6c-90bf-4b64cc44babb will not be triggered until provisioned by entity DHCP. {{(pid=84113) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 17:57:58.144911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:58.163979 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:57:58.302622 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Pushing event updated for resources: {'Port': ['ID=6b45b530-2619-4e6c-90bf-4b64cc44babb,revision_number=1']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:57:58.315079 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:58.315459 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:58.315831 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:58.316245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:58.316609 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:58.316970 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:58.317326 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:58.317682 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:58.318037 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:58.318390 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:58.318746 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:58.319093 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Tracked resource versions report: Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: pushed versions: Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: { 'AddressGroup': {'1.1'}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': {'1.0'}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': {'1.0'}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': {'1.1'}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': {'1.7'}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': {'1.2'}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': {'1.8'}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': {'1.4'}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': {'1.2'}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': {'1.0'}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': {'1.1'}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': {'1.1'}} Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: consumer versions: Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: { DHCP agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: L3 agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: Metadata agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: Metering agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: Open vSwitch agent@dv-cinder-760194-3-iscsi: { 'AddressGroup': '1.1', Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': '1.0', Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': '1.0', Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': '1.1', Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': '1.7', Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': '1.2', Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': '1.8', Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': '1.4', Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': '1.2', Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': '1.0', Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': '1.1', Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': '1.1'}} Feb 17 17:57:58.320279 dv-cinder-760194-3-iscsi neutron-server[84000]: {{(pid=84113) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Feb 17 17:57:58.335101 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:57:58.371923 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Network 7f6a9784-1806-4e7c-a274-a93f7a9ae71e is already hosted by enough agents. {{(pid=84113) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 17:57:58.373139 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Resources bound (agent type, host, resource id): {{(pid=84113) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 17:57:58.376090 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Received port after_create {{(pid=84113) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 17:57:58.438874 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Attempting to bind port 6b45b530-2619-4e6c-90bf-4b64cc44babb on host dv-cinder-760194-3-iscsi for vnic_type normal with profile {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 17:57:58.439350 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Attempting to bind port 6b45b530-2619-4e6c-90bf-4b64cc44babb by drivers openvswitch on host dv-cinder-760194-3-iscsi at level 0 using segments [{'id': '7a6f2c3b-61cf-4267-a8d2-bb6769336d23', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 1, 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e'}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 17:57:58.439766 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Attempting to bind port 6b45b530-2619-4e6c-90bf-4b64cc44babb on network 7f6a9784-1806-4e7c-a274-a93f7a9ae71e {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 17:57:58.445348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Checking agent: {'id': '3fdd9543-fb8c-4d73-992e-15dd132fbdf2', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760194-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'started_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 17, 57, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760194-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.58', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 17:57:58.445767 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Checking segment: {'id': '7a6f2c3b-61cf-4267-a8d2-bb6769336d23', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 1, 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84113) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 17:57:58.447074 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:58.447074 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Bound using segment: {'id': '7a6f2c3b-61cf-4267-a8d2-bb6769336d23', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 1, 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e'} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 17:57:58.447255 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Bound port: 6b45b530-2619-4e6c-90bf-4b64cc44babb, host: dv-cinder-760194-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7a6f2c3b-61cf-4267-a8d2-bb6769336d23', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 1, 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e'}}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 17:57:58.447673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:58.543736 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] For port 6b45b530-2619-4e6c-90bf-4b64cc44babb, host dv-cinder-760194-3-iscsi, cleared binding levels {{(pid=84113) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 17:57:58.547790 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] For port 6b45b530-2619-4e6c-90bf-4b64cc44babb, host dv-cinder-760194-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=6b45b530-2619-4e6c-90bf-4b64cc44babb,segment=NetworkSegment(7a6f2c3b-61cf-4267-a8d2-bb6769336d23),segment_id=7a6f2c3b-61cf-4267-a8d2-bb6769336d23)] {{(pid=84113) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 17:57:58.578297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:57:58.594111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:57:58.742504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Pushing event updated for resources: {'Port': ['ID=6b45b530-2619-4e6c-90bf-4b64cc44babb,revision_number=2']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:57:58.747626 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:57:59.735759 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 51496) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:58:00.140112 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [None req-4af759de-18c6-4420-95da-8d3f49657343 admin admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=84112) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 17 17:58:00.141327 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-4af759de-18c6-4420-95da-8d3f49657343 admin admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13455 time: 0.4045579 Feb 17 17:58:02.040243 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 6b45b530-2619-4e6c-90bf-4b64cc44babb up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 17:58:02.154663 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning for port 6b45b530-2619-4e6c-90bf-4b64cc44babb completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 17:58:02.891235 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 51510) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:58:03.296397 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [None req-6f65d57d-49de-417a-87b9-f993a918ddf3 admin admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=84112) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 17 17:58:03.311906 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-6f65d57d-49de-417a-87b9-f993a918ddf3 admin admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13455 time: 0.4052365 Feb 17 17:58:03.590810 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec8ddcae-862c-4185-bacb-a8db240d37ea None None] Network 7f6a9784-1806-4e7c-a274-a93f7a9ae71e requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 17:58:03.726245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-813ef778-41ad-4353-a42c-9c621b02d703 None None] Provisioning for port 6b45b530-2619-4e6c-90bf-4b64cc44babb completed by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 17:58:03.737137 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-813ef778-41ad-4353-a42c-9c621b02d703 None None] Provisioning complete for port 6b45b530-2619-4e6c-90bf-4b64cc44babb triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 17:58:03.737563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-813ef778-41ad-4353-a42c-9c621b02d703 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:03.965254 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-813ef778-41ad-4353-a42c-9c621b02d703 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:04.008468 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-813ef778-41ad-4353-a42c-9c621b02d703 None None] For port 6b45b530-2619-4e6c-90bf-4b64cc44babb, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=6b45b530-2619-4e6c-90bf-4b64cc44babb,segment=NetworkSegment(7a6f2c3b-61cf-4267-a8d2-bb6769336d23),segment_id=7a6f2c3b-61cf-4267-a8d2-bb6769336d23)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 17:58:04.038022 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-813ef778-41ad-4353-a42c-9c621b02d703 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:04.040799 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:04.115114 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-813ef778-41ad-4353-a42c-9c621b02d703 None None] Pushing event updated for resources: {'Port': ['ID=6b45b530-2619-4e6c-90bf-4b64cc44babb,revision_number=3']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:04.119759 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-813ef778-41ad-4353-a42c-9c621b02d703 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:04.261945 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-cd427e33-1a11-402e-8e7e-627f879bd477 None None] Provisioning complete for port 6b45b530-2619-4e6c-90bf-4b64cc44babb triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 17:58:04.262355 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cd427e33-1a11-402e-8e7e-627f879bd477 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:04.512460 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-35b449fb-7792-4263-bc20-047d36c945b7 None None] Provisioning complete for port 6b45b530-2619-4e6c-90bf-4b64cc44babb triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 17:58:04.513040 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-35b449fb-7792-4263-bc20-047d36c945b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:06.022914 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 6b45b530-2619-4e6c-90bf-4b64cc44babb up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 17:58:06.094955 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 6b45b530-2619-4e6c-90bf-4b64cc44babb triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 17:58:06.095364 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:06.316892 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 51522) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:58:06.695685 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-6dd1f03e-7555-4be8-8e27-39a0d257c371 admin admin] Request body: {'router': {'name': 'router1', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'admin_state_up': True}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 17:58:06.701642 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-6dd1f03e-7555-4be8-8e27-39a0d257c371 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 17:58:06.705631 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-6dd1f03e-7555-4be8-8e27-39a0d257c371 admin admin] Usage tracker for resource:router and tenant:1219ec43351448b5b60b9c9397391f95 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 17:58:06.708812 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-6dd1f03e-7555-4be8-8e27-39a0d257c371 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 17:58:06.714889 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-6dd1f03e-7555-4be8-8e27-39a0d257c371 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 17:58:06.771359 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6dd1f03e-7555-4be8-8e27-39a0d257c371 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-395995', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-5288'] for router, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:06.772754 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6dd1f03e-7555-4be8-8e27-39a0d257c371 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-395820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036854319730', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request--9223372036853142595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider--9223372036854770544'] for router, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:06.854685 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6dd1f03e-7555-4be8-8e27-39a0d257c371 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:06.989239 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6dd1f03e-7555-4be8-8e27-39a0d257c371 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create--9223372036854379860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-456206'] for router, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:07.034141 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6dd1f03e-7555-4be8-8e27-39a0d257c371 admin admin] Notify callbacks [] for router, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:07.035403 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-6dd1f03e-7555-4be8-8e27-39a0d257c371 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.7174292 Feb 17 17:58:07.679903 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f85555c3-c894-4f3d-bde3-856b29af36e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:09.753335 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 51532) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:58:09.794652 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-080a419e-81b9-4cbe-8f51-c6d494c4eef7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:10.108406 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 5 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 17:58:10.377409 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING oslo_policy.policy [None req-219aaad5-a633-4f61-b1bc-613d05619880 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 17 17:58:10.377992 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING oslo_policy.policy [None req-219aaad5-a633-4f61-b1bc-613d05619880 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 17 17:58:10.609916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [None req-219aaad5-a633-4f61-b1bc-613d05619880 admin admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=84111) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 17 17:58:10.611293 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-219aaad5-a633-4f61-b1bc-613d05619880 admin admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13455 time: 0.8559918 Feb 17 17:58:10.760815 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:11.981068 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:12.669048 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:13.338272 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 51556) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:58:13.500469 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Request body: {'network': {'provider:network_type': 'flat', 'name': 'public', 'is_default': True, 'router:external': True, 'provider:physical_network': 'physnet1', 'admin_state_up': True}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 17:58:13.503357 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.quota [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Loaded quota_driver: . Feb 17 17:58:13.519979 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 17:58:13.526636 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Usage tracker for resource:network and tenant:363eccccbf2e4380b1dde5c4b3f0ab4b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 17:58:13.531181 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 17:58:13.538636 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 17:58:13.637567 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Made reservation on behalf of 363eccccbf2e4380b1dde5c4b3f0ab4b for: {'network': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 17:58:13.687198 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.policy [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=84111) register_rules /opt/stack/neutron/neutron/policy.py:75}} Feb 17 17:58:13.723848 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING oslo_policy.policy [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 17 17:58:13.724280 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING oslo_policy.policy [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 17 17:58:13.754368 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:13.774042 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:13.791219 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 17:58:13.795137 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Usage tracker for resource:security_group_rule and tenant:363eccccbf2e4380b1dde5c4b3f0ab4b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 17:58:13.798474 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 17:58:13.804115 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 17:58:14.170343 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:14.197314 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:14.202109 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:14.213673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Reserving flat network on physical network physnet1 {{(pid=84111) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:101}} Feb 17 17:58:14.294286 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment--9223363306798059772', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:14.294858 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Unsubscribe: segment precommit_create {{(pid=84111) unsubscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:84}} Feb 17 17:58:14.295335 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Added segment b5e97d06-6722-4de8-9658-658adc74c7b4 of type flat for network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 Feb 17 17:58:14.349114 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=586b5218-cc45-460a-82b7-c5d6b5e57335,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:14.372876 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:14.373250 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:14.373616 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:14.373973 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:14.374328 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:14.374683 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:14.375032 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:14.375380 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:14.375725 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:14.376098 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:14.376445 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:14.376790 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Tracked resource versions report: Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: pushed versions: Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: { 'AddressGroup': {'1.1'}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': {'1.0'}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': {'1.0'}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': {'1.1'}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': {'1.7'}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': {'1.2'}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': {'1.8'}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': {'1.4'}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': {'1.2'}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': {'1.0'}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': {'1.1'}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': {'1.1'}} Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: consumer versions: Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: { DHCP agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: L3 agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: Metadata agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: Metering agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: Open vSwitch agent@dv-cinder-760194-3-iscsi: { 'AddressGroup': '1.1', Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': '1.0', Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': '1.0', Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': '1.1', Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': '1.7', Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': '1.2', Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': '1.8', Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': '1.4', Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': '1.2', Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': '1.0', Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': '1.1', Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': '1.1'}} Feb 17 17:58:14.377925 dv-cinder-760194-3-iscsi neutron-server[84000]: {{(pid=84111) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Feb 17 17:58:14.410489 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:14.485495 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:14.565702 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:14.567033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 17:58:14.567703 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:14.573216 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:14.683159 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Pushing event updated for resources: {'Network': ['ID=68fd415f-8606-43f8-b4d1-98e6a9c9af94,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:14.686843 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:14.694479 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 17:58:14.712893 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 1.3734188 Feb 17 17:58:17.259195 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 51582) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:58:17.378691 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84e9e348-5d95-403a-ab1e-3507730709b9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 17:58:17.380182 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-84e9e348-5d95-403a-ab1e-3507730709b9 admin admin] 10.222.0.13 "GET /v2.0/subnets/5f24c70f-8bec-4c96-afa0-e740139099e4 HTTP/1.1" status: 200 len: 849 time: 0.1199465 Feb 17 17:58:17.558594 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f3fc8f77-6708-4ac1-8c35-e0dfe3653b5b admin admin] 10.222.0.13 "GET /v2.0/routers/78aea0d5-fc3d-46f6-b001-5436f1d8607c HTTP/1.1" status: 200 len: 704 time: 0.1717072 Feb 17 17:58:18.047218 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:18.438653 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Allocated IP 172.20.0.1 (7f6a9784-1806-4e7c-a274-a93f7a9ae71e/5f24c70f-8bec-4c96-afa0-e740139099e4/7b492789-879b-471e-9731-1969b7dff3ab) {{(pid=84111) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 17:58:18.821523 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Notify callbacks [] for port, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:18.840832 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Transition to ACTIVE for port object 7b492789-879b-471e-9731-1969b7dff3ab will not be triggered until provisioned by entity DHCP. {{(pid=84111) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 17:58:18.924046 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:18.939631 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:19.072621 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Pushing event updated for resources: {'Port': ['ID=7b492789-879b-471e-9731-1969b7dff3ab,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:19.078930 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:19.132557 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Network 7f6a9784-1806-4e7c-a274-a93f7a9ae71e is already hosted by enough agents. {{(pid=84111) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 17:58:19.134218 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Resources bound (agent type, host, resource id): {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 17:58:19.137155 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Received port after_create {{(pid=84111) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 17:58:19.137674 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036854376681'] for router_interface, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:19.432303 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-87dbacbb-502c-4760-9ccc-345b8a602b1c None None] Provisioning for port 7b492789-879b-471e-9731-1969b7dff3ab completed by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 17:58:19.437277 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-87dbacbb-502c-4760-9ccc-345b8a602b1c None None] Provisioning complete for port 7b492789-879b-471e-9731-1969b7dff3ab triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 17:58:19.437835 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-87dbacbb-502c-4760-9ccc-345b8a602b1c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:19.456947 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:19.496833 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-87dbacbb-502c-4760-9ccc-345b8a602b1c None None] Port 7b492789-879b-471e-9731-1969b7dff3ab cannot update to ACTIVE because it is not bound. {{(pid=84113) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:332}} Feb 17 17:58:19.749982 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Notify callbacks [] for port, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:19.776927 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:19.778034 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1681264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-399217'] for router_interface, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:19.792949 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:19.927345 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Pushing event updated for resources: {'Port': ['ID=7b492789-879b-471e-9731-1969b7dff3ab,revision_number=2']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:19.931562 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:19.985299 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Network 7f6a9784-1806-4e7c-a274-a93f7a9ae71e is already hosted by enough agents. {{(pid=84111) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 17:58:19.986402 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Resources bound (agent type, host, resource id): {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 17:58:20.220617 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-37dfb496-ad97-40d9-8434-dbaa4ffb83c5 None None] Provisioning complete for port 7b492789-879b-471e-9731-1969b7dff3ab triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 17:58:20.221009 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-37dfb496-ad97-40d9-8434-dbaa4ffb83c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:20.226355 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Router 78aea0d5-fc3d-46f6-b001-5436f1d8607c is scheduled to L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b with binding_index 1 {{(pid=84111) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:214}} Feb 17 17:58:20.276722 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-37dfb496-ad97-40d9-8434-dbaa4ffb83c5 None None] Port 7b492789-879b-471e-9731-1969b7dff3ab cannot update to ACTIVE because it is not bound. {{(pid=84113) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:332}} Feb 17 17:58:20.392827 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84111) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 17:58:20.402209 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] 10.222.0.13 "PUT /v2.0/routers/78aea0d5-fc3d-46f6-b001-5436f1d8607c/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.8378108 Feb 17 17:58:20.402738 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Sync routers for ids ['78aea0d5-fc3d-46f6-b001-5436f1d8607c'] in dv-cinder-760194-3-iscsi {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 17:58:20.414076 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Routers {'78aea0d5-fc3d-46f6-b001-5436f1d8607c'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 17:58:20.415458 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T17:58:10Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['78aea0d5-fc3d-46f6-b001-5436f1d8607c'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:58:20.606631 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Set router 78aea0d5-fc3d-46f6-b001-5436f1d8607c gateway port host: None {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 17:58:21.162977 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'name': 'router1', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T17:58:06Z', 'updated_at': '2021-02-17T17:58:19Z', 'revision_number': 2, 'project_id': '1219ec43351448b5b60b9c9397391f95', 'gw_port_host': None, '_interfaces': [{'id': '7b492789-879b-471e-9731-1969b7dff3ab', 'name': '', 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'mac_address': 'fa:16:3e:8a:51:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5f24c70f-8bec-4c96-afa0-e740139099e4', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T17:58:18Z', 'updated_at': '2021-02-17T17:58:19Z', 'revision_number': 2, 'project_id': '1219ec43351448b5b60b9c9397391f95', 'subnets': [{'id': '5f24c70f-8bec-4c96-afa0-e740139099e4', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1f90ea06-1591-4b97-a03b-8a78dd08349e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:58:21.168618 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Checking router: 78aea0d5-fc3d-46f6-b001-5436f1d8607c for host: dv-cinder-760194-3-iscsi {{(pid=84114) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 17:58:21.169005 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Updating router 78aea0d5-fc3d-46f6-b001-5436f1d8607c port 7b492789-879b-471e-9731-1969b7dff3ab binding host dv-cinder-760194-3-iscsi {{(pid=84114) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:208}} Feb 17 17:58:21.227595 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:21.679597 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Notify callbacks [] for port, precommit_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:21.694084 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Transition to ACTIVE for port object 7b492789-879b-471e-9731-1969b7dff3ab will not be triggered until provisioned by entity L2. {{(pid=84114) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 17:58:21.719842 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:21.737026 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:21.876887 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Pushing event updated for resources: {'Port': ['ID=7b492789-879b-471e-9731-1969b7dff3ab,revision_number=3']} {{(pid=84114) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:21.897459 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:21.897833 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:21.898206 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:21.898569 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:21.899563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:21.899932 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:21.900332 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:21.900644 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:21.901038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:21.901388 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:21.901740 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:21.902091 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Tracked resource versions report: Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: pushed versions: Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: { 'AddressGroup': {'1.1'}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': {'1.0'}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': {'1.0'}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': {'1.1'}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': {'1.7'}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': {'1.2'}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': {'1.8'}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': {'1.4'}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': {'1.2'}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': {'1.0'}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': {'1.1'}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': {'1.1'}} Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: consumer versions: Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: { DHCP agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: L3 agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: Metadata agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: Metering agent@dv-cinder-760194-3-iscsi: {}, Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: Open vSwitch agent@dv-cinder-760194-3-iscsi: { 'AddressGroup': '1.1', Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': '1.0', Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': '1.0', Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': '1.1', Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': '1.7', Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': '1.2', Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': '1.8', Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': '1.4', Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': '1.2', Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': '1.0', Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': '1.1', Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': '1.1'}} Feb 17 17:58:21.903224 dv-cinder-760194-3-iscsi neutron-server[84000]: {{(pid=84114) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Feb 17 17:58:21.910321 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:22.059658 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Attempting to bind port 7b492789-879b-471e-9731-1969b7dff3ab on host dv-cinder-760194-3-iscsi for vnic_type normal with profile {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 17:58:22.060108 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Attempting to bind port 7b492789-879b-471e-9731-1969b7dff3ab by drivers openvswitch on host dv-cinder-760194-3-iscsi at level 0 using segments [{'id': '7a6f2c3b-61cf-4267-a8d2-bb6769336d23', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 1, 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e'}] {{(pid=84114) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 17:58:22.060519 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Attempting to bind port 7b492789-879b-471e-9731-1969b7dff3ab on network 7f6a9784-1806-4e7c-a274-a93f7a9ae71e {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 17:58:22.066410 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Checking agent: {'id': '3fdd9543-fb8c-4d73-992e-15dd132fbdf2', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760194-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'started_at': datetime.datetime(2021, 2, 17, 17, 58, 12), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 17, 58, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760194-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.58', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 17:58:22.066844 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Checking segment: {'id': '7a6f2c3b-61cf-4267-a8d2-bb6769336d23', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 1, 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84114) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 17:58:22.067317 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:22.067747 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Bound using segment: {'id': '7a6f2c3b-61cf-4267-a8d2-bb6769336d23', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 1, 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e'} {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 17:58:22.068318 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Bound port: 7b492789-879b-471e-9731-1969b7dff3ab, host: dv-cinder-760194-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7a6f2c3b-61cf-4267-a8d2-bb6769336d23', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 1, 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e'}}] {{(pid=84114) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 17:58:22.068758 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:22.165719 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] For port 7b492789-879b-471e-9731-1969b7dff3ab, host dv-cinder-760194-3-iscsi, cleared binding levels {{(pid=84114) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 17:58:22.170313 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] For port 7b492789-879b-471e-9731-1969b7dff3ab, host dv-cinder-760194-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=7b492789-879b-471e-9731-1969b7dff3ab,segment=NetworkSegment(7a6f2c3b-61cf-4267-a8d2-bb6769336d23),segment_id=7a6f2c3b-61cf-4267-a8d2-bb6769336d23)] {{(pid=84114) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 17:58:22.235146 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:22.251361 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:22.401737 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Pushing event updated for resources: {'Port': ['ID=7b492789-879b-471e-9731-1969b7dff3ab,revision_number=4']} {{(pid=84114) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:22.407056 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:22.466832 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Routers {'78aea0d5-fc3d-46f6-b001-5436f1d8607c'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 17:58:22.467516 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T17:58:10Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['78aea0d5-fc3d-46f6-b001-5436f1d8607c'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:58:22.640325 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] Set router 78aea0d5-fc3d-46f6-b001-5436f1d8607c gateway port host: None {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 17:58:22.940247 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 51594) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:58:22.983789 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'name': 'router1', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T17:58:06Z', 'updated_at': '2021-02-17T17:58:19Z', 'revision_number': 2, 'project_id': '1219ec43351448b5b60b9c9397391f95', 'gw_port_host': None, '_interfaces': [{'id': '7b492789-879b-471e-9731-1969b7dff3ab', 'name': '', 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'mac_address': 'fa:16:3e:8a:51:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5f24c70f-8bec-4c96-afa0-e740139099e4', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T17:58:18Z', 'updated_at': '2021-02-17T17:58:22Z', 'revision_number': 4, 'project_id': '1219ec43351448b5b60b9c9397391f95', 'subnets': [{'id': '5f24c70f-8bec-4c96-afa0-e740139099e4', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1f90ea06-1591-4b97-a03b-8a78dd08349e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:58:22.989160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1fdf713-54b1-4edb-9d99-2b985db73891 None None] The sync data for ids ['78aea0d5-fc3d-46f6-b001-5436f1d8607c'] in dv-cinder-760194-3-iscsi is: [{'id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'name': 'router1', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T17:58:06Z', 'updated_at': '2021-02-17T17:58:19Z', 'revision_number': 2, 'project_id': '1219ec43351448b5b60b9c9397391f95', 'gw_port_host': None, '_interfaces': [{'id': '7b492789-879b-471e-9731-1969b7dff3ab', 'name': '', 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'mac_address': 'fa:16:3e:8a:51:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5f24c70f-8bec-4c96-afa0-e740139099e4', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T17:58:18Z', 'updated_at': '2021-02-17T17:58:22Z', 'revision_number': 4, 'project_id': '1219ec43351448b5b60b9c9397391f95', 'subnets': [{'id': '5f24c70f-8bec-4c96-afa0-e740139099e4', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1f90ea06-1591-4b97-a03b-8a78dd08349e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}] {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 17:58:23.253732 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-649dc695-5c45-48b9-9ff4-876feab35e6f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 17:58:23.254355 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-649dc695-5c45-48b9-9ff4-876feab35e6f admin admin] Synchronizing usage tracker for tenant:363eccccbf2e4380b1dde5c4b3f0ab4b on resource:network {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 17:58:23.308566 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-649dc695-5c45-48b9-9ff4-876feab35e6f admin admin] Unset dirty status for tenant:363eccccbf2e4380b1dde5c4b3f0ab4b on resource:network {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 17:58:23.309922 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-649dc695-5c45-48b9-9ff4-876feab35e6f admin admin] 10.222.0.13 "GET /v2.0/networks/68fd415f-8606-43f8-b4d1-98e6a9c9af94 HTTP/1.1" status: 200 len: 842 time: 0.3686392 Feb 17 17:58:23.320403 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Request body: {'subnet': {'ip_version': 4, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'gateway_ip': '172.27.1.1', 'cidr': '172.27.1.0/24', 'enable_dhcp': False, 'name': 'public-subnet'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 17:58:23.326303 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 17:58:23.330274 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Usage tracker for resource:subnet and tenant:363eccccbf2e4380b1dde5c4b3f0ab4b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 17:58:23.333289 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 17:58:23.340133 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 17:58:23.377259 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Made reservation on behalf of 363eccccbf2e4380b1dde5c4b3f0ab4b for: {'subnet': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 17:58:23.382000 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Notify callbacks [] for subnet, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:24.056390 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 7b492789-879b-471e-9731-1969b7dff3ab up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 17:58:24.063638 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.objects.ports [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=84111) get_objects /opt/stack/neutron/neutron/objects/ports.py:431}} Feb 17 17:58:24.064171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for subnet, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:24.080710 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:24.160523 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning for port 7b492789-879b-471e-9731-1969b7dff3ab completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 17:58:24.166210 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 7b492789-879b-471e-9731-1969b7dff3ab triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 17:58:24.166627 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:24.221861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1c895d8f-55ff-4bdb-a323-742172b9934e,revision_number=0']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:24.228866 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:24.282494 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Checking segment: {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84111) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 17:58:24.282890 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Network hostable DHCP agents. Network: 68fd415f-8606-43f8-b4d1-98e6a9c9af94, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84111) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 17:58:24.295641 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:24.354805 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84111) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 17:58:24.394174 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] For port 7b492789-879b-471e-9731-1969b7dff3ab, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=7b492789-879b-471e-9731-1969b7dff3ab,segment=NetworkSegment(7a6f2c3b-61cf-4267-a8d2-bb6769336d23),segment_id=7a6f2c3b-61cf-4267-a8d2-bb6769336d23)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 17:58:24.411534 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, 68fd415f-8606-43f8-b4d1-98e6a9c9af94) {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 17:58:24.415955 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 17:58:24.416592 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:24.420543 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2c44f0a-216c-4f35-a16e-e7d80231a481 None None] Network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 17:58:24.464020 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1474752 Feb 17 17:58:24.484169 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:24.502023 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:24.615222 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Pushing event updated for resources: {'Port': ['ID=7b492789-879b-471e-9731-1969b7dff3ab,revision_number=5']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:24.622248 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:24.731743 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96fa9b29-c786-4241-8f83-9ff8dc08654a None None] Network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 17:58:26.031232 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 7b492789-879b-471e-9731-1969b7dff3ab up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 17:58:26.106515 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 7b492789-879b-471e-9731-1969b7dff3ab triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 17:58:26.106904 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:27.038161 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 51608) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:58:27.245144 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-8a4d0c0f-2ca8-41fd-ad59-7e52f999e402 admin admin] 10.222.0.13 "GET /v2.0/routers/78aea0d5-fc3d-46f6-b001-5436f1d8607c HTTP/1.1" status: 200 len: 710 time: 0.2057686 Feb 17 17:58:27.380593 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8b7af46-1769-473a-a0c7-98c3f2c6a4ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 17:58:27.382039 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-b8b7af46-1769-473a-a0c7-98c3f2c6a4ba admin admin] 10.222.0.13 "GET /v2.0/networks/68fd415f-8606-43f8-b4d1-98e6a9c9af94 HTTP/1.1" status: 200 len: 886 time: 0.1310000 Feb 17 17:58:27.391931 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 17:58:27.850910 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036854319563', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036854379843', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider--9223372036854770557'] for router, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:28.398836 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:28.457799 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:28.469950 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:28.485135 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 17:58:28.489063 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Usage tracker for resource:security_group_rule and tenant: is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 17:58:28.491979 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 17:58:28.502850 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 17:58:28.764865 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:28.799511 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:28.815082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:28.905699 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84ae72c7-4dc7-4b92-b3b2-048701a1079b,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:28.909360 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:29.072759 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Allocated IP 172.27.1.130 (68fd415f-8606-43f8-b4d1-98e6a9c9af94/1c895d8f-55ff-4bdb-a323-742172b9934e/aac7c16b-2e67-4ddf-9299-a89543d828f9) {{(pid=84111) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 17:58:29.221758 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:29.300346 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:29.315322 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c381feb9-ada7-47bd-a4c5-a8f78ef15658 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:29.445056 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Pushing event updated for resources: {'Port': ['ID=aac7c16b-2e67-4ddf-9299-a89543d828f9,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:29.447972 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:29.500285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 is already hosted by enough agents. {{(pid=84111) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 17:58:29.501456 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Resources bound (agent type, host, resource id): {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 17:58:29.506422 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Received port after_create {{(pid=84111) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 17:58:29.993669 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:30.345527 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036854319563', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036854379843', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider--9223372036854770557'] for router, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:30.348949 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-456206', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-456253', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change--9223372036854319610', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-395956'] for router, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:30.537586 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Router 78aea0d5-fc3d-46f6-b001-5436f1d8607c has already been hosted by L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b {{(pid=84111) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:130}} Feb 17 17:58:30.899863 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84111) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 17:58:30.915032 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Sync routers for ids ['78aea0d5-fc3d-46f6-b001-5436f1d8607c'] in dv-cinder-760194-3-iscsi {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 17:58:30.915909 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Notify callbacks [] for router, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:30.919153 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] 10.222.0.13 "PUT /v2.0/routers/78aea0d5-fc3d-46f6-b001-5436f1d8607c HTTP/1.1" status: 200 len: 890 time: 3.5285268 Feb 17 17:58:30.925397 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Routers {'78aea0d5-fc3d-46f6-b001-5436f1d8607c'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 17:58:30.926209 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T17:58:10Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['78aea0d5-fc3d-46f6-b001-5436f1d8607c'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:58:31.127512 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Set router 78aea0d5-fc3d-46f6-b001-5436f1d8607c gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 17:58:31.491556 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'name': 'router1', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.130'}], 'enable_snat': True}, 'gw_port_id': 'aac7c16b-2e67-4ddf-9299-a89543d828f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T17:58:06Z', 'updated_at': '2021-02-17T17:58:29Z', 'revision_number': 4, 'project_id': '1219ec43351448b5b60b9c9397391f95', 'gw_port': {'id': 'aac7c16b-2e67-4ddf-9299-a89543d828f9', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:ad:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T17:58:28Z', 'updated_at': '2021-02-17T17:58:29Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': '7b492789-879b-471e-9731-1969b7dff3ab', 'name': '', 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'mac_address': 'fa:16:3e:8a:51:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5f24c70f-8bec-4c96-afa0-e740139099e4', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T17:58:18Z', 'updated_at': '2021-02-17T17:58:24Z', 'revision_number': 5, 'project_id': '1219ec43351448b5b60b9c9397391f95', 'subnets': [{'id': '5f24c70f-8bec-4c96-afa0-e740139099e4', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1f90ea06-1591-4b97-a03b-8a78dd08349e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:58:31.497355 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Checking router: 78aea0d5-fc3d-46f6-b001-5436f1d8607c for host: dv-cinder-760194-3-iscsi {{(pid=84113) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 17:58:31.497740 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Updating router 78aea0d5-fc3d-46f6-b001-5436f1d8607c port aac7c16b-2e67-4ddf-9299-a89543d828f9 binding host dv-cinder-760194-3-iscsi {{(pid=84113) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:208}} Feb 17 17:58:31.553247 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:31.959436 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Notify callbacks [] for port, precommit_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:32.020650 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Transition to ACTIVE for port object aac7c16b-2e67-4ddf-9299-a89543d828f9 will not be triggered until provisioned by entity L2. {{(pid=84113) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 17:58:32.077549 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:32.093701 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7bd8c7e8-6b7b-42ce-83af-7b53fbaa49c8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:32.228395 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a652432c-347b-4c50-99d1-bd3f29df62d5 None None] Pushing event updated for resources: {'Port': ['ID=aac7c16b-2e67-4ddf-9299-a89543d828f9,revision_number=2']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:32.234371 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a652432c-347b-4c50-99d1-bd3f29df62d5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:32.446311 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Attempting to bind port aac7c16b-2e67-4ddf-9299-a89543d828f9 on host dv-cinder-760194-3-iscsi for vnic_type normal with profile {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 17:58:32.446710 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Attempting to bind port aac7c16b-2e67-4ddf-9299-a89543d828f9 by drivers openvswitch on host dv-cinder-760194-3-iscsi at level 0 using segments [{'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 17:58:32.447109 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Attempting to bind port aac7c16b-2e67-4ddf-9299-a89543d828f9 on network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 17:58:32.452704 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Checking agent: {'id': '3fdd9543-fb8c-4d73-992e-15dd132fbdf2', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760194-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'started_at': datetime.datetime(2021, 2, 17, 17, 58, 12), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 17, 58, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760194-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.58', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 17:58:32.466555 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Checking segment: {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84113) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 17:58:32.466555 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:32.466555 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Bound using segment: {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 17:58:32.466555 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Bound port: aac7c16b-2e67-4ddf-9299-a89543d828f9, host: dv-cinder-760194-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 17:58:32.466555 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:32.529865 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] For port aac7c16b-2e67-4ddf-9299-a89543d828f9, host dv-cinder-760194-3-iscsi, cleared binding levels {{(pid=84113) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 17:58:32.533051 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] For port aac7c16b-2e67-4ddf-9299-a89543d828f9, host dv-cinder-760194-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=aac7c16b-2e67-4ddf-9299-a89543d828f9,segment=NetworkSegment(b5e97d06-6722-4de8-9658-658adc74c7b4),segment_id=b5e97d06-6722-4de8-9658-658adc74c7b4)] {{(pid=84113) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 17:58:32.581555 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:32.613027 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:32.777669 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a652432c-347b-4c50-99d1-bd3f29df62d5 None None] Pushing event updated for resources: {'Port': ['ID=aac7c16b-2e67-4ddf-9299-a89543d828f9,revision_number=3']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:32.783109 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a652432c-347b-4c50-99d1-bd3f29df62d5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:32.821252 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Routers {'78aea0d5-fc3d-46f6-b001-5436f1d8607c'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 17:58:32.821916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T17:58:10Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['78aea0d5-fc3d-46f6-b001-5436f1d8607c'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:58:33.012894 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] Set router 78aea0d5-fc3d-46f6-b001-5436f1d8607c gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 17:58:33.357646 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'name': 'router1', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.130'}], 'enable_snat': True}, 'gw_port_id': 'aac7c16b-2e67-4ddf-9299-a89543d828f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T17:58:06Z', 'updated_at': '2021-02-17T17:58:29Z', 'revision_number': 4, 'project_id': '1219ec43351448b5b60b9c9397391f95', 'gw_port': {'id': 'aac7c16b-2e67-4ddf-9299-a89543d828f9', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:ad:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T17:58:28Z', 'updated_at': '2021-02-17T17:58:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': '7b492789-879b-471e-9731-1969b7dff3ab', 'name': '', 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'mac_address': 'fa:16:3e:8a:51:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5f24c70f-8bec-4c96-afa0-e740139099e4', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T17:58:18Z', 'updated_at': '2021-02-17T17:58:24Z', 'revision_number': 5, 'project_id': '1219ec43351448b5b60b9c9397391f95', 'subnets': [{'id': '5f24c70f-8bec-4c96-afa0-e740139099e4', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1f90ea06-1591-4b97-a03b-8a78dd08349e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 17:58:33.361707 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c836685-b87b-446d-9711-290e4dd32386 None None] The sync data for ids ['78aea0d5-fc3d-46f6-b001-5436f1d8607c'] in dv-cinder-760194-3-iscsi is: [{'id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'name': 'router1', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.130'}], 'enable_snat': True}, 'gw_port_id': 'aac7c16b-2e67-4ddf-9299-a89543d828f9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T17:58:06Z', 'updated_at': '2021-02-17T17:58:29Z', 'revision_number': 4, 'project_id': '1219ec43351448b5b60b9c9397391f95', 'gw_port': {'id': 'aac7c16b-2e67-4ddf-9299-a89543d828f9', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:ad:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 26, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T17:58:28Z', 'updated_at': '2021-02-17T17:58:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': '7b492789-879b-471e-9731-1969b7dff3ab', 'name': '', 'network_id': '7f6a9784-1806-4e7c-a274-a93f7a9ae71e', 'tenant_id': '1219ec43351448b5b60b9c9397391f95', 'mac_address': 'fa:16:3e:8a:51:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78aea0d5-fc3d-46f6-b001-5436f1d8607c', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5f24c70f-8bec-4c96-afa0-e740139099e4', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T17:58:18Z', 'updated_at': '2021-02-17T17:58:24Z', 'revision_number': 5, 'project_id': '1219ec43351448b5b60b9c9397391f95', 'subnets': [{'id': '5f24c70f-8bec-4c96-afa0-e740139099e4', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1f90ea06-1591-4b97-a03b-8a78dd08349e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}] {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 17:58:33.618846 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 51618) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 17:58:33.746383 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc3039bb-d956-4a34-8bcd-f93aafa7e072 admin admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 17:58:33.748066 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-cc3039bb-d956-4a34-8bcd-f93aafa7e072 admin admin] 10.222.0.13 "GET /v2.0/ports?device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 1080 time: 0.1281133 Feb 17 17:58:34.061864 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device aac7c16b-2e67-4ddf-9299-a89543d828f9 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 17:58:34.177170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning for port aac7c16b-2e67-4ddf-9299-a89543d828f9 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 17:58:34.182885 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port aac7c16b-2e67-4ddf-9299-a89543d828f9 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 17:58:34.183008 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:34.314072 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:34.331375 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] For port aac7c16b-2e67-4ddf-9299-a89543d828f9, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=aac7c16b-2e67-4ddf-9299-a89543d828f9,segment=NetworkSegment(b5e97d06-6722-4de8-9658-658adc74c7b4),segment_id=b5e97d06-6722-4de8-9658-658adc74c7b4)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 17:58:34.363232 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:34.366297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-813ef778-41ad-4353-a42c-9c621b02d703 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 17:58:34.439544 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Pushing event updated for resources: {'Port': ['ID=aac7c16b-2e67-4ddf-9299-a89543d828f9,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 17:58:34.442913 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 17:58:36.051607 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device aac7c16b-2e67-4ddf-9299-a89543d828f9 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 17:58:36.130547 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port aac7c16b-2e67-4ddf-9299-a89543d828f9 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 17:58:36.130940 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:37.741456 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-820cccd1-af8f-40f9-b484-c172b5831571 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:39.855428 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-06712d1d-a0fb-4180-bf53-ca64963fd493 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:40.780490 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:42.015554 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:42.691051 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:58:47.107766 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 5 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 17:59:07.688699 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c485b5ca-8f24-4cb1-97c0-ea3cb4d01db3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:59:09.804896 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7a8ea6a1-4314-47cc-a82d-cac2e94c80f3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:59:10.765208 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:59:11.982146 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:59:12.673526 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:59:24.110975 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 5 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 17:59:37.675893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e4e2304f-0a56-43c2-bb6a-5a32e4d17d55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:59:39.804633 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-55434ad9-c0e6-4a2e-b623-98e2a79f403e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:59:40.776346 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:59:42.176720 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 17:59:42.690328 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:01.110826 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 5 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:00:07.672997 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-02992041-09d6-4a22-a1bb-93111aef457a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:09.806747 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3137b0ec-95d7-493b-aca2-789314bb55de None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:10.772522 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:11.972541 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:12.684071 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:37.663425 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-05086ec6-7cf2-409e-befe-eb6a8c7e01c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:38.111678 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 5 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:00:39.826707 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9f81c852-1c33-4cde-8c9c-f4c48a72eb4b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:40.780820 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:41.981287 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:42.689383 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:47.584692 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52194) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:00:47.659143 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.pecan_wsgi.hooks.translation [None req-79daeb31-312e-413c-8bc6-7021918aca0e admin admin] GET failed (client error): The resource could not be found. Feb 17 18:00:47.660550 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-79daeb31-312e-413c-8bc6-7021918aca0e admin admin] 10.222.0.13 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0748436 Feb 17 18:00:47.802306 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00c92a58-bbf9-4bab-9196-4e71191a00b5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:00:47.803814 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-00c92a58-bbf9-4bab-9196-4e71191a00b5 admin admin] 10.222.0.13 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 865 time: 0.1388819 Feb 17 18:00:50.239017 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52204) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:00:50.353292 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23617fdc-029e-4160-9876-bc3cedf3b88d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:00:50.353823 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-23617fdc-029e-4160-9876-bc3cedf3b88d admin admin] Synchronizing usage tracker for tenant:363eccccbf2e4380b1dde5c4b3f0ab4b on resource:subnet {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:00:50.420952 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-23617fdc-029e-4160-9876-bc3cedf3b88d admin admin] Unset dirty status for tenant:363eccccbf2e4380b1dde5c4b3f0ab4b on resource:subnet {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:00:50.422207 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-23617fdc-029e-4160-9876-bc3cedf3b88d admin admin] 10.222.0.13 "GET /v2.0/subnets/5f24c70f-8bec-4c96-afa0-e740139099e4 HTTP/1.1" status: 200 len: 849 time: 0.1821647 Feb 17 18:00:50.432499 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:00:50.558247 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Notify callbacks [] for subnet, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:50.912614 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update--9223363306798023642'] for subnet, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:50.928079 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e7a92c8e-f2e9-4c9d-9ffb-a03d5807e119 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:00:51.063067 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5f24c70f-8bec-4c96-afa0-e740139099e4,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:00:51.083913 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:00:51.084301 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:00:51.084677 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:00:51.085042 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:00:51.085780 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:00:51.085780 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:00:51.086097 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:00:51.086454 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:00:51.086832 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:00:51.087186 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:00:51.087539 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:00:51.087988 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:00:51.091686 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:00:51.121341 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:00:51.121999 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:51.123368 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] 10.222.0.13 "PUT /v2.0/subnets/5f24c70f-8bec-4c96-afa0-e740139099e4 HTTP/1.1" status: 200 len: 868 time: 0.6950085 Feb 17 18:00:51.139226 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7cd9b13-88f8-4fd5-8db6-1f4cbb9446d1 None None] Network 7f6a9784-1806-4e7c-a274-a93f7a9ae71e requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:00:51.664812 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b9263f49-4adf-44b2-a6d5-60131f3008ae None None] Provisioning complete for port 6b45b530-2619-4e6c-90bf-4b64cc44babb triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:00:51.665315 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b9263f49-4adf-44b2-a6d5-60131f3008ae None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:51.796089 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b9263f49-4adf-44b2-a6d5-60131f3008ae None None] Provisioning complete for port 7b492789-879b-471e-9731-1969b7dff3ab triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:00:51.796504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b9263f49-4adf-44b2-a6d5-60131f3008ae None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:00:53.585983 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52214) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:00:53.773318 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a402900e-ce24-427d-bf97-1a864928ac39 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:00:53.773663 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a402900e-ce24-427d-bf97-1a864928ac39 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:00:53.775849 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-a402900e-ce24-427d-bf97-1a864928ac39 admin admin] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1542 time: 0.1881790 Feb 17 18:00:56.234545 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52224) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:00:56.418404 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-129b8c69-e8dd-46c6-ab3b-b299a7d72f38 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:00:56.418749 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-129b8c69-e8dd-46c6-ab3b-b299a7d72f38 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:00:56.420417 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-129b8c69-e8dd-46c6-ab3b-b299a7d72f38 admin admin] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1542 time: 0.1848495 Feb 17 18:00:58.877315 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52234) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:00:59.055107 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e376642f-bfa5-4fae-9d7e-484e36755e40 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:00:59.057183 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e376642f-bfa5-4fae-9d7e-484e36755e40 admin admin] 10.222.0.13 "GET /v2.0/networks/68fd415f-8606-43f8-b4d1-98e6a9c9af94 HTTP/1.1" status: 200 len: 886 time: 0.1789072 Feb 17 18:01:01.544088 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52244) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:01:01.730730 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fea5aaf9-f33d-40e9-9e02-ca2a9e739974 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:01:01.732151 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-fea5aaf9-f33d-40e9-9e02-ca2a9e739974 admin admin] 10.222.0.13 "GET /v2.0/networks/7f6a9784-1806-4e7c-a274-a93f7a9ae71e HTTP/1.1" status: 200 len: 862 time: 0.1870255 Feb 17 18:01:04.200950 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52254) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:01:04.319531 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01d5cb76-3c81-473c-8c81-bb074bd5f16e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:01:04.319900 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01d5cb76-3c81-473c-8c81-bb074bd5f16e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:01:04.321510 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-01d5cb76-3c81-473c-8c81-bb074bd5f16e admin admin] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1195505 Feb 17 18:01:06.752672 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52264) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:01:06.865675 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-773f81ce-25ab-4829-ba67-1c7eedb60990 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:01:06.866137 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-773f81ce-25ab-4829-ba67-1c7eedb60990 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:01:06.867686 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-773f81ce-25ab-4829-ba67-1c7eedb60990 admin admin] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1139638 Feb 17 18:01:07.685889 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b61dec8d-ef24-48fd-8106-6074c830a3fe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:09.320661 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52274) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:01:09.427664 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e623011-78fc-48b8-ac67-3400ea76f321 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:01:09.429142 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-7e623011-78fc-48b8-ac67-3400ea76f321 admin admin] 10.222.0.13 "GET /v2.0/subnets/1c895d8f-55ff-4bdb-a323-742172b9934e HTTP/1.1" status: 200 len: 816 time: 0.1074693 Feb 17 18:01:09.809237 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-770ae94d-a26b-4538-b3a3-2b2e87e42122 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:10.780805 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:11.919391 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52284) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:01:11.994199 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:12.041366 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-895737b5-357f-4448-96d6-dedddecd2808 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:01:12.042829 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-895737b5-357f-4448-96d6-dedddecd2808 admin admin] 10.222.0.13 "GET /v2.0/subnets/5f24c70f-8bec-4c96-afa0-e740139099e4 HTTP/1.1" status: 200 len: 868 time: 0.1223528 Feb 17 18:01:12.691454 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:15.110735 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 5 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:01:37.679692 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1a069ac8-4261-4112-955c-db92905ea544 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:37.732597 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52324) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:01:37.784371 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [None req-c648046c-a543-4e33-959e-69414d560999 admin admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=84112) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 17 18:01:37.785471 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c648046c-a543-4e33-959e-69414d560999 admin admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13455 time: 0.0518284 Feb 17 18:01:39.814697 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-78ba2f4f-017f-4bab-a834-71d17bad6229 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:40.310084 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52334) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:01:40.384190 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.pecan_wsgi.hooks.translation [None req-158da996-dec3-4799-8d24-718bd5ae9b9a admin admin] GET failed (client error): The resource could not be found. Feb 17 18:01:40.385561 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-158da996-dec3-4799-8d24-718bd5ae9b9a admin admin] 10.222.0.13 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0744734 Feb 17 18:01:40.520110 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93a9cce3-57b5-4c5c-8e6d-7d03d5918011 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:01:40.521681 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-93a9cce3-57b5-4c5c-8e6d-7d03d5918011 admin admin] 10.222.0.13 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1317904 Feb 17 18:01:40.786055 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:41.988178 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:42.702215 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:42.999318 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52344) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:01:43.049701 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:01:43.054586 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:01:43.064732 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:01:43.113438 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Made reservation on behalf of 363eccccbf2e4380b1dde5c4b3f0ab4b for: {'network': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:01:43.118462 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:43.211948 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING neutron.services.revisions.revision_plugin [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Could not find related network for resource to bump revision. Feb 17 18:01:43.229988 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] vxlan segment allocate from pool success with {'vxlan_vni': 2} {{(pid=84112) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:151}} Feb 17 18:01:43.286793 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment--9223363306798059772', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:43.287245 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Added segment b4dd9026-2905-431b-aeed-c57d49a13982 of type vxlan for network 44d4c3ac-b614-4624-ac9c-e4fae7dab349 Feb 17 18:01:43.313539 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:43.364901 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:43.366159 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:01:43.366784 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:43.371521 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:01:43.476853 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Pushing event updated for resources: {'Network': ['ID=44d4c3ac-b614-4624-ac9c-e4fae7dab349,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:01:43.483820 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:43.484237 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:43.484605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:43.484971 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:43.485326 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:43.485695 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:43.486047 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:43.486444 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:43.486806 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:43.487155 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:43.487504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:43.487849 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:43.491708 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:01:43.499309 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network 44d4c3ac-b614-4624-ac9c-e4fae7dab349 details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:01:43.514469 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 840 time: 0.5140393 Feb 17 18:01:45.984730 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52354) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:01:46.058922 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.pecan_wsgi.hooks.translation [None req-e01f4d69-cc9c-453d-802b-4eb2c82984ea admin admin] GET failed (client error): The resource could not be found. Feb 17 18:01:46.059482 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e01f4d69-cc9c-453d-802b-4eb2c82984ea admin admin] Synchronizing usage tracker for tenant:363eccccbf2e4380b1dde5c4b3f0ab4b on resource:network {{(pid=84112) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:01:46.130420 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e01f4d69-cc9c-453d-802b-4eb2c82984ea admin admin] Unset dirty status for tenant:363eccccbf2e4380b1dde5c4b3f0ab4b on resource:network {{(pid=84112) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:01:46.131624 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e01f4d69-cc9c-453d-802b-4eb2c82984ea admin admin] 10.222.0.13 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.1458902 Feb 17 18:01:46.391326 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3687f5e4-ba94-4e89-a1c9-151bf47bc89c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:01:46.392920 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3687f5e4-ba94-4e89-a1c9-151bf47bc89c admin admin] 10.222.0.13 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 819 time: 0.2562573 Feb 17 18:01:46.403573 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Request body: {'subnet': {'description': 'shared-subnet', 'network_id': '44d4c3ac-b614-4624-ac9c-e4fae7dab349', 'ip_version': 4, 'name': 'shared-subnet', 'cidr': '192.168.233.0/24'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:01:46.408111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:01:46.418142 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:01:46.459707 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Made reservation on behalf of 363eccccbf2e4380b1dde5c4b3f0ab4b for: {'subnet': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:01:46.464317 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Notify callbacks [] for subnet, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:46.874567 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for subnet, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:46.891976 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c562e081-1506-4045-81c3-9082bc271a2a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:01:47.010137 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Pushing event updated for resources: {'Subnet': ['ID=38b1f6d9-4e09-4afc-a4e8-aa8cc12286c0,revision_number=0']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:01:47.013007 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:01:47.081996 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Checking segment: {'id': 'b4dd9026-2905-431b-aeed-c57d49a13982', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 2, 'network_id': '44d4c3ac-b614-4624-ac9c-e4fae7dab349'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:01:47.082374 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Network hostable DHCP agents. Network: 44d4c3ac-b614-4624-ac9c-e4fae7dab349, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84112) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 18:01:47.128389 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Network 44d4c3ac-b614-4624-ac9c-e4fae7dab349 is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84112) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 18:01:47.156871 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, 44d4c3ac-b614-4624-ac9c-e4fae7dab349) {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:01:47.160817 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:01:47.161457 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:47.167343 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23e62bd5-23f3-4a11-a2d6-cec7ebd831f4 None None] Network 44d4c3ac-b614-4624-ac9c-e4fae7dab349 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:01:47.219909 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-1ca96b04-f49b-4308-a256-75b81f514202 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.8094959 Feb 17 18:01:47.404837 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa801fd4f-d9d9-59b5-9186-1ec4edf3a9c6-44d4c3ac-b614-4624-ac9c-e4fae7dab349', 'network_id': '44d4c3ac-b614-4624-ac9c-e4fae7dab349', 'tenant_id': '363eccccbf2e4380b1dde5c4b3f0ab4b', 'fixed_ips': [{'subnet_id': '38b1f6d9-4e09-4afc-a4e8-aa8cc12286c0'}]}} from dv-cinder-760194-3-iscsi. {{(pid=84113) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Feb 17 18:01:47.405755 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:47.692694 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Allocated IP 192.168.233.2 (44d4c3ac-b614-4624-ac9c-e4fae7dab349/38b1f6d9-4e09-4afc-a4e8-aa8cc12286c0/748bd95c-9e04-44fd-af5b-dc198ed51541) {{(pid=84113) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:01:47.977083 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Notify callbacks [] for port, precommit_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:48.034044 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Transition to ACTIVE for port object 748bd95c-9e04-44fd-af5b-dc198ed51541 will not be triggered until provisioned by entity L2. {{(pid=84113) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:01:48.051160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Transition to ACTIVE for port object 748bd95c-9e04-44fd-af5b-dc198ed51541 will not be triggered until provisioned by entity DHCP. {{(pid=84113) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:01:48.080196 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:48.096957 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:01:48.226535 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Pushing event updated for resources: {'Port': ['ID=748bd95c-9e04-44fd-af5b-dc198ed51541,revision_number=1']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:01:48.237220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:48.237604 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:48.237977 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:48.238345 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:48.238710 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:48.239078 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:48.239441 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:48.239801 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:48.240214 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:48.240573 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:48.240931 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:48.241287 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:01:48.247379 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:01:48.300152 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Network 44d4c3ac-b614-4624-ac9c-e4fae7dab349 is already hosted by enough agents. {{(pid=84113) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:01:48.301391 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Resources bound (agent type, host, resource id): {{(pid=84113) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:01:48.303849 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Received port after_create {{(pid=84113) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:01:48.365229 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Attempting to bind port 748bd95c-9e04-44fd-af5b-dc198ed51541 on host dv-cinder-760194-3-iscsi for vnic_type normal with profile {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:01:48.365637 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Attempting to bind port 748bd95c-9e04-44fd-af5b-dc198ed51541 by drivers openvswitch on host dv-cinder-760194-3-iscsi at level 0 using segments [{'id': 'b4dd9026-2905-431b-aeed-c57d49a13982', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 2, 'network_id': '44d4c3ac-b614-4624-ac9c-e4fae7dab349'}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:01:48.366034 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Attempting to bind port 748bd95c-9e04-44fd-af5b-dc198ed51541 on network 44d4c3ac-b614-4624-ac9c-e4fae7dab349 {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:01:48.372349 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Checking agent: {'id': '3fdd9543-fb8c-4d73-992e-15dd132fbdf2', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760194-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'started_at': datetime.datetime(2021, 2, 17, 17, 58, 12), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 1, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760194-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.58', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:01:48.372807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Checking segment: {'id': 'b4dd9026-2905-431b-aeed-c57d49a13982', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 2, 'network_id': '44d4c3ac-b614-4624-ac9c-e4fae7dab349'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84113) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:01:48.373238 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:48.373666 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Bound using segment: {'id': 'b4dd9026-2905-431b-aeed-c57d49a13982', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 2, 'network_id': '44d4c3ac-b614-4624-ac9c-e4fae7dab349'} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:01:48.374177 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Bound port: 748bd95c-9e04-44fd-af5b-dc198ed51541, host: dv-cinder-760194-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b4dd9026-2905-431b-aeed-c57d49a13982', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 2, 'network_id': '44d4c3ac-b614-4624-ac9c-e4fae7dab349'}}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:01:48.374574 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:48.467710 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] For port 748bd95c-9e04-44fd-af5b-dc198ed51541, host dv-cinder-760194-3-iscsi, cleared binding levels {{(pid=84113) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:01:48.471340 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] For port 748bd95c-9e04-44fd-af5b-dc198ed51541, host dv-cinder-760194-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=748bd95c-9e04-44fd-af5b-dc198ed51541,segment=NetworkSegment(b4dd9026-2905-431b-aeed-c57d49a13982),segment_id=b4dd9026-2905-431b-aeed-c57d49a13982)] {{(pid=84113) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:01:48.525941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:48.542070 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:01:48.700005 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Pushing event updated for resources: {'Port': ['ID=748bd95c-9e04-44fd-af5b-dc198ed51541,revision_number=2']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:01:48.705501 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:01:49.965881 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffb0ed28-5c13-488e-9bdc-91f9e4d2b2ce None None] Network 44d4c3ac-b614-4624-ac9c-e4fae7dab349 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:01:50.126336 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-814665ef-ec1e-4d7a-8681-20f564c377e2 None None] Provisioning for port 748bd95c-9e04-44fd-af5b-dc198ed51541 completed by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:01:50.190415 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 748bd95c-9e04-44fd-af5b-dc198ed51541 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:01:50.348092 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning for port 748bd95c-9e04-44fd-af5b-dc198ed51541 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:01:50.354326 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 748bd95c-9e04-44fd-af5b-dc198ed51541 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:01:50.354852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:50.496420 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:50.511129 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-d4e15f0e-8a2c-4ba7-aa7a-0b898849551d None None] Provisioning complete for port 748bd95c-9e04-44fd-af5b-dc198ed51541 triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:01:50.514521 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d4e15f0e-8a2c-4ba7-aa7a-0b898849551d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:50.586532 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] For port 748bd95c-9e04-44fd-af5b-dc198ed51541, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=748bd95c-9e04-44fd-af5b-dc198ed51541,segment=NetworkSegment(b4dd9026-2905-431b-aeed-c57d49a13982),segment_id=b4dd9026-2905-431b-aeed-c57d49a13982)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:01:50.635028 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:50.651595 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:01:50.733824 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Pushing event updated for resources: {'Port': ['ID=748bd95c-9e04-44fd-af5b-dc198ed51541,revision_number=3']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:01:50.737420 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:01:50.840698 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-7798ffcc-9a59-47e7-869b-a8c5e2ea6be7 None None] Provisioning complete for port 748bd95c-9e04-44fd-af5b-dc198ed51541 triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:01:50.841237 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7798ffcc-9a59-47e7-869b-a8c5e2ea6be7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:01:52.110826 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 5 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:01:52.137653 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 748bd95c-9e04-44fd-af5b-dc198ed51541 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:01:52.209705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 748bd95c-9e04-44fd-af5b-dc198ed51541 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:01:52.210123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:02:07.673290 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1bd4f035-14dd-4c1b-86a8-6e996fd6824b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:02:09.810237 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3454f385-c088-449e-8545-ac059adc240d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:02:10.797314 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:02:11.993163 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:02:12.705281 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:02:29.110313 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 5 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:02:37.733701 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-145d1752-4464-4cc7-839d-d4d87d89d553 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:02:39.813801 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-890cffae-68df-4097-8429-e1d884ea16ee None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:02:40.792538 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:02:42.003847 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:02:42.746992 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:01.042867 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52396) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:03:01.049076 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [None req-9e41c4ae-3c89-420f-9f33-567b7ef950cc tempest-verify_tempest_config-1894631142 tempest-verify_tempest_config-1894631142-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=84112) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 17 18:03:01.050132 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-9e41c4ae-3c89-420f-9f33-567b7ef950cc tempest-verify_tempest_config-1894631142 tempest-verify_tempest_config-1894631142-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13450 time: 0.0062275 Feb 17 18:03:01.506263 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52416) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:03:01.628816 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:01.643987 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:03:01.647992 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Usage tracker for resource:security_group_rule and tenant:1859e06f56d044d881f22c074907caac is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:03:01.651381 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:03:01.657109 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:03:02.014703 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:02.047809 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:02.059712 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:03:02.102228 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1859e06f56d044d881f22c074907caac&name=default HTTP/1.1" status: 200 len: 2975 time: 0.5948150 Feb 17 18:03:02.103086 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38a1ee36-cb49-4921-bdb6-1f2333acfb15,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:03:02.105096 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52422) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:03:02.110343 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.110729 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.111098 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.111464 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.111823 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.112220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.112578 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.112932 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.113299 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.113652 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.114005 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.114805 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.118510 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:03:02.169878 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:02.196422 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:02.283177 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:02.288554 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:03:02.301589 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38a1ee36-cb49-4921-bdb6-1f2333acfb15,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:03:02.309078 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:02.310264 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/38a1ee36-cb49-4921-bdb6-1f2333acfb15 HTTP/1.1" status: 204 len: 168 time: 0.2041035 Feb 17 18:03:02.311625 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.312022 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.312389 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.312749 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.313893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.314253 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.314628 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.314994 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.315356 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.315717 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.316100 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.316458 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:03:02.319700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:03:06.111118 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 5 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:03:07.683334 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d2ff22b6-5cce-4c13-9076-237952e883fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:09.814957 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-97d440e1-3c3d-4cfc-aaf5-8f248410551c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:10.791765 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:11.997605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:12.710503 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:37.694028 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bad34e7b-3bcd-4340-91a3-7efcc899bf1a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:39.802644 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-5f142454-d941-46bc-8856-0a666e386fc1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:40.791330 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:41.997052 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:42.705221 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:03:43.111097 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 5 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:04:07.682171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b61d30c3-bbe2-41c2-b08c-532a673d9f47 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:04:09.806383 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-699704fd-9267-4c42-ba92-a2a481229ddb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:04:10.794969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:04:11.996271 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:04:12.716489 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:04:20.109853 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 5 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:04:37.692922 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6da6f5ec-eeba-4fcd-b1d5-8589aaf51737 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:04:39.801598 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-977fa056-6365-42e3-b96a-e399b19af8b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:04:40.800521 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:04:42.006184 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:04:42.732007 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:04:46.898483 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590'] for agent, after_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:04:46.899014 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:04:46.899231 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:04:46.899607 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:04:46.900091 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:04:46.900478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:04:46.900898 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:04:46.901274 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:04:46.901642 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:04:46.902008 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:04:46.902375 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:04:46.902893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:04:46.903306 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:04:46.903698 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'hv-cinder-76019', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.1'}) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:04:46.907713 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'hv-cinder-76019', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.1'}} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:04:47.180093 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] get_endpoint_by_host() called for host hv-cinder-76019 {{(pid=84113) get_endpoint_by_host /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:347}} Feb 17 18:04:47.184063 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] get_endpoint_by_ip() called for ip 192.168.0.34 {{(pid=84113) get_endpoint_by_ip /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:353}} Feb 17 18:04:47.187794 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] _add_endpoint() called for ip 192.168.0.34 {{(pid=84113) _add_endpoint /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:377}} Feb 17 18:04:47.218098 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] _get_endpoints() called {{(pid=84113) _get_endpoints /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:372}} Feb 17 18:04:57.110344 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:04:58.978648 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52494) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:04:59.096250 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-d6f99ad9-1dad-4417-9c2e-ecabe47b4c96 admin admin] 10.222.0.13 "GET /v2.0/agents HTTP/1.1" status: 200 len: 5085 time: 0.1163864 Feb 17 18:05:01.574837 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52504) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:05:01.634920 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-bdc6526b-3bba-4c7d-9670-2af47df50def admin admin] 10.222.0.13 "GET /v2.0/agents HTTP/1.1" status: 200 len: 5085 time: 0.0582016 Feb 17 18:05:07.691369 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b15297f8-a2bb-4b4c-8c08-332c6c3f3b3e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:05:09.806566 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-00257b84-ee8c-4e87-982c-8b7bcaa7801b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:05:10.789467 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:05:11.995183 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:05:12.732338 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:05:16.909158 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:05:34.109732 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:05:37.680531 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b950ccab-81e1-4fdb-8059-92eadcd91db3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:05:39.800401 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-43782eeb-c497-45de-b785-b2891959937a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:05:40.800091 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:05:41.994021 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:05:42.725680 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:05:46.897175 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:07.685732 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0a4203db-a5e6-4738-901a-fd0b8ac68d4c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:09.811173 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-25abb97d-547a-45ac-a23c-5c2a37992275 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:10.816605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:11.109238 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:06:12.005393 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:12.736430 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:16.914288 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:37.674490 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a24a0b17-9715-46e9-925c-47432873fecd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:39.811506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-480d216d-c5b1-4cd0-92ba-634389907001 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:40.313273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52656) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:40.736924 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1294029612-network', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:40.744824 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:40.750646 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Usage tracker for resource:network and tenant:bda7a35e855840d7bc75e16e402f3690 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:40.754262 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:40.763742 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:40.799120 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Made reservation on behalf of bda7a35e855840d7bc75e16e402f3690 for: {'network': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:40.804010 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:40.817895 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:40.833578 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:40.833954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:40.842427 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Usage tracker for resource:security_group_rule and tenant:bda7a35e855840d7bc75e16e402f3690 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:40.845722 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:40.851815 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:40.941488 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52688) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:40.992570 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:41.056520 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:41.061426 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f339029e-0238-4f48-8a17-d23fc2a0f7fa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:41.094852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a4b39df-00a5-4eff-9100-12943c73c018,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:41.103060 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.103416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.103765 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.104393 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.105385 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.105920 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.106284 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.106640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.106993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.107344 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.107795 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.108150 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Tracked resource versions report: Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: pushed versions: Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: { 'AddressGroup': {'1.1'}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': {'1.0'}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': {'1.0'}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': {'1.1'}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': {'1.7'}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': {'1.2'}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': {'1.8'}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': {'1.4'}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': {'1.2'}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': {'1.0'}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': {'1.1'}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': {'1.1'}} Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: consumer versions: Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: { DHCP agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: L3 agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: Metadata agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: Metering agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: Open vSwitch agent@dv-cinder-760194-3-iscsi: { 'AddressGroup': '1.1', Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': '1.0', Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': '1.0', Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': '1.1', Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': '1.7', Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': '1.2', Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': '1.8', Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': '1.4', Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': '1.2', Feb 17 18:06:41.118518 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': '1.0', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': '1.1', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': '1.1'}, Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: Open vSwitch agent@hv-cinder-76019: { 'AddressGroup': '1.1', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': '1.0', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': '1.0', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': '1.1', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': '1.7', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': '1.2', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': '1.8', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': '1.4', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': '1.2', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': '1.0', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': '1.1', Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': '1.1'}} Feb 17 18:06:41.122445 dv-cinder-760194-3-iscsi neutron-server[84000]: {{(pid=84111) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Feb 17 18:06:41.130556 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:41.138249 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] vxlan segment allocate from pool success with {'vxlan_vni': 3} {{(pid=84111) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:151}} Feb 17 18:06:41.149186 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:41.149694 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Added segment eaf585ce-3bb4-4c27-942c-8aa396958840 of type vxlan for network 4aaf4a03-4480-421f-bff4-f9814e969001 Feb 17 18:06:41.178768 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:41.285348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:41.287030 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:41.288547 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:41.298381 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:41.358103 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52702) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:41.410555 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Pushing event updated for resources: {'Network': ['ID=4aaf4a03-4480-421f-bff4-f9814e969001,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:41.413751 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:41.421456 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network 4aaf4a03-4480-421f-bff4-f9814e969001 details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:06:41.436968 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52708) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:41.437150 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.1219923 Feb 17 18:06:41.439034 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Request body: {'subnet': {'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1294029612-subnet', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:41.445217 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:41.450441 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Usage tracker for resource:subnet and tenant:bda7a35e855840d7bc75e16e402f3690 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:41.453801 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:41.460208 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:41.490537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1982434031-network', 'tenant_id': 'c2e8792284c348238cf9afdcae0c221e'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:41.496393 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:41.500731 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Usage tracker for resource:network and tenant:c2e8792284c348238cf9afdcae0c221e is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:41.503991 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:41.510791 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:41.514855 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Made reservation on behalf of bda7a35e855840d7bc75e16e402f3690 for: {'subnet': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:41.518325 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Network 4aaf4a03-4480-421f-bff4-f9814e969001 details requested by agent ovs-agent-hv-cinder-76019 with host hv-cinder-76019 {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:06:41.520911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Notify callbacks [] for subnet, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:41.596143 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52714) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:41.722617 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52726) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:41.770565 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Made reservation on behalf of c2e8792284c348238cf9afdcae0c221e for: {'network': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:41.776148 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:41.789573 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:41.810976 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:41.817213 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Usage tracker for resource:security_group_rule and tenant:c2e8792284c348238cf9afdcae0c221e is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:41.822329 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:41.861939 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:41.867162 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-757239-network', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:41.881012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-252817276-network', 'tenant_id': '7a25651c22014108b99126a82207cf5b'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:41.887426 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:41.893133 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Usage tracker for resource:network and tenant:7a25651c22014108b99126a82207cf5b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:41.896724 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:41.905168 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:41.906627 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:41.923585 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1093594594-network', 'tenant_id': 'ea1a0242f4cf40fd9bd267013f65af40'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:41.923921 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Usage tracker for resource:network and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:41.930855 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:41.931717 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:41.937844 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Usage tracker for resource:network and tenant:ea1a0242f4cf40fd9bd267013f65af40 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:41.942365 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:41.942500 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:41.960696 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:41.965307 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Made reservation on behalf of 7a25651c22014108b99126a82207cf5b for: {'network': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:41.970271 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:41.988170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:41.999231 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.015614 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:42.020720 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Usage tracker for resource:security_group_rule and tenant:7a25651c22014108b99126a82207cf5b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:42.024460 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:42.032751 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:42.050770 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Made reservation on behalf of bd48a3996f1246f1ab69d3866874af0b for: {'network': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:42.055934 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.056840 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Made reservation on behalf of ea1a0242f4cf40fd9bd267013f65af40 for: {'network': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:42.062796 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.079016 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.104875 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:42.109212 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Usage tracker for resource:security_group_rule and tenant:ea1a0242f4cf40fd9bd267013f65af40 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:42.112255 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:42.118211 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:42.137640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.184214 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:42.201448 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Usage tracker for resource:security_group_rule and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:42.205541 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:42.211168 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.214919 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:42.260289 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.274030 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:42.325116 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d30a6557-543f-4cae-be17-0884747c77f6,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:42.331633 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] vxlan segment allocate from pool success with {'vxlan_vni': 4} {{(pid=84112) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:151}} Feb 17 18:06:42.367905 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.375517 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.376202 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.377125 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.377300 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.377930 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.378512 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.378992 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.379457 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.379953 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.380420 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.380885 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.381346 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.381947 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.382413 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.382878 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.383331 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.383786 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.384284 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.384743 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.385200 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.385712 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.386215 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.386676 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.387221 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Tracked resource versions report: Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: pushed versions: Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: { 'AddressGroup': {'1.1'}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': {'1.0'}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': {'1.0'}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': {'1.1'}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': {'1.7'}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': {'1.2'}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': {'1.8'}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': {'1.4'}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': {'1.2'}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': {'1.0'}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': {'1.1'}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': {'1.1'}} Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: consumer versions: Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: { DHCP agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: L3 agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: Metadata agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: Metering agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: Open vSwitch agent@dv-cinder-760194-3-iscsi: { 'AddressGroup': '1.1', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': '1.0', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': '1.0', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': '1.1', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': '1.7', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': '1.2', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': '1.8', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': '1.4', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': '1.2', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': '1.0', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': '1.1', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': '1.1'}, Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: Open vSwitch agent@hv-cinder-76019: { 'AddressGroup': '1.1', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': '1.0', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': '1.0', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': '1.1', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': '1.7', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': '1.2', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': '1.8', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': '1.4', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': '1.2', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': '1.0', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': '1.1', Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': '1.1'}} Feb 17 18:06:42.388712 dv-cinder-760194-3-iscsi neutron-server[84000]: {{(pid=84112) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Feb 17 18:06:42.396022 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:42.398651 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment--9223363306798059772', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.399221 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Added segment dc9d9960-339b-4f6e-a3d3-9084931321b3 of type vxlan for network ee1c48e9-8681-4765-bc5b-bc0215d911a4 Feb 17 18:06:42.418875 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.429186 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:42.461011 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.489699 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.498975 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17e0eced-062a-4742-8379-f04c949c37d1,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:42.503194 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:42.504710 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.509970 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:42.510567 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.551039 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for subnet, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.555104 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dfc3bd3a-afcf-4c5b-9bdb-9a49c7353a11,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:42.559652 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:42.607379 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:42.683457 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.db.api [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Retry wrapper got retriable exception: Unable to create the network. No available network found in maximum allowed attempts. {{(pid=84111) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Feb 17 18:06:42.683849 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_db.api [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_network {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Feb 17 18:06:42.684453 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.db.api [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Retry wrapper got retriable exception: Unable to create the network. No available network found in maximum allowed attempts. {{(pid=84111) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Feb 17 18:06:42.684781 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_db.api [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_network {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Feb 17 18:06:42.723099 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.733868 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.742430 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.757007 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:42.757666 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.805376 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] vxlan segment allocate from pool success with {'vxlan_vni': 5} {{(pid=84112) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:151}} Feb 17 18:06:42.811610 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Pushing event updated for resources: {'Subnet': ['ID=c04f01da-1295-4b8a-95ae-46589cb07040,revision_number=0']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:42.815188 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:42.824118 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.068s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:42.888090 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment--9223363306798059772', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:42.888542 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Added segment a3b9a246-e8d6-47cc-bbb0-e0531b20a903 of type vxlan for network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 Feb 17 18:06:42.912239 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ccc1ae6e-7348-451a-8b45-32717908ac1a,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:42.915803 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:42.920893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fa15f91b-0d43-4d6a-be16-112960902544 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.153s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:43.023246 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 2.0804675 Feb 17 18:06:43.026703 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52780) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:43.033124 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Request body: {'subnet': {'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1982434031-subnet', 'tenant_id': 'c2e8792284c348238cf9afdcae0c221e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:43.043171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:43.050142 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Usage tracker for resource:subnet and tenant:c2e8792284c348238cf9afdcae0c221e is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:43.050364 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.055457 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:43.065628 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:43.072483 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Pushing event updated for resources: {'Network': ['ID=ee1c48e9-8681-4765-bc5b-bc0215d911a4,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:43.076179 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:43.085333 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Network ee1c48e9-8681-4765-bc5b-bc0215d911a4 details requested by agent ovs-agent-hv-cinder-76019 with host hv-cinder-76019 {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:06:43.095402 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Checking segment: {'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:06:43.096017 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Network hostable DHCP agents. Network: 4aaf4a03-4480-421f-bff4-f9814e969001, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84112) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 18:06:43.107264 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network ee1c48e9-8681-4765-bc5b-bc0215d911a4 details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:06:43.119446 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Made reservation on behalf of c2e8792284c348238cf9afdcae0c221e for: {'subnet': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:43.125172 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Notify callbacks [] for subnet, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.153778 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.155126 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:43.155770 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.161229 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:43.211420 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.225317 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.266305 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Network 4aaf4a03-4480-421f-bff4-f9814e969001 is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84112) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 18:06:43.346807 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 879 time: 1.9838977 Feb 17 18:06:43.347031 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52790) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:43.350078 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Pushing event updated for resources: {'Network': ['ID=8e56c377-33ba-47b0-9d75-fa2421d9f1e2,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:43.361891 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:43.366580 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Request body: {'subnet': {'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-subnet', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:43.372548 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:43.375040 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, 4aaf4a03-4480-421f-bff4-f9814e969001) {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:06:43.388933 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Usage tracker for resource:subnet and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:43.392557 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:43.395599 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:43.396279 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.412796 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:43.445853 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:06:43.458814 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 2.0239666 Feb 17 18:06:43.461648 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52796) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:43.471106 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1294029612-router', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:43.476774 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:43.478096 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 details requested by agent ovs-agent-hv-cinder-76019 with host hv-cinder-76019 {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:06:43.488239 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Usage tracker for resource:router and tenant:bda7a35e855840d7bc75e16e402f3690 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:43.507788 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Made reservation on behalf of bd48a3996f1246f1ab69d3866874af0b for: {'subnet': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:43.510649 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Notify callbacks [] for subnet, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.511711 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5cf5f658-930e-4189-9442-15c3a7a8784b None None] Network 4aaf4a03-4480-421f-bff4-f9814e969001 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:06:43.543522 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:43.554113 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] vxlan segment allocate from pool success with {'vxlan_vni': 6} {{(pid=84111) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:151}} Feb 17 18:06:43.568382 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.568776 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Added segment e39a606a-42ef-4057-9215-ad4d588cb178 of type vxlan for network d0113fdf-2728-4712-b5a7-48b6cde96686 Feb 17 18:06:43.641513 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:43.710789 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.720230 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-395995', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-5288'] for router, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.721486 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-395820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036854319730', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request--9223372036853142595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider--9223372036854770544'] for router, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.874363 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.876710 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:43.877917 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.909225 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:43.922310 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:43.949366 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.db.api [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Retry wrapper got retriable exception: Unable to create the network. No available network found in maximum allowed attempts. {{(pid=84111) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Feb 17 18:06:43.950004 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_db.api [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_network {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Feb 17 18:06:43.972419 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for subnet, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:44.107954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86a9a15c-f20d-4aa7-9e44-1ed9c9e06280 None None] Network 4aaf4a03-4480-421f-bff4-f9814e969001 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:06:44.301414 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:44.323674 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 2.7257116 Feb 17 18:06:44.339933 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52828) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:44.364090 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Request body: {'subnet': {'network_id': 'd0113fdf-2728-4712-b5a7-48b6cde96686', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-252817276-subnet', 'tenant_id': '7a25651c22014108b99126a82207cf5b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:44.377639 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:44.388684 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Pushing event updated for resources: {'Network': ['ID=d0113fdf-2728-4712-b5a7-48b6cde96686,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:44.391343 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Usage tracker for resource:subnet and tenant:7a25651c22014108b99126a82207cf5b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:44.397264 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.475s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:44.399984 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:44.402410 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.413s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:44.441974 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Network d0113fdf-2728-4712-b5a7-48b6cde96686 details requested by agent ovs-agent-hv-cinder-76019 with host hv-cinder-76019 {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:06:44.456803 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] vxlan segment allocate from pool success with {'vxlan_vni': 7} {{(pid=84111) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:151}} Feb 17 18:06:44.467507 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:44.467915 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Added segment c2d54292-0536-4a70-b118-0e7d52b9d0a7 of type vxlan for network 9a6c905d-f0c9-4c01-8dcc-f31837172714 Feb 17 18:06:44.469637 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network d0113fdf-2728-4712-b5a7-48b6cde96686 details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:06:44.527078 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:44.636064 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:44.644519 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036854319563', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036854379843', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider--9223372036854770557'] for router, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:44.709335 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Pushing event updated for resources: {'Subnet': ['ID=e1b65f5a-677d-4368-874f-50623d3454b9,revision_number=0']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:44.713093 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.311s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:44.722077 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:44.743849 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:44.744742 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:44.783969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:44.814241 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Made reservation on behalf of 7a25651c22014108b99126a82207cf5b for: {'subnet': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:44.832787 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Notify callbacks [] for subnet, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:44.925798 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52856) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:45.162507 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 878 time: 3.4386890 Feb 17 18:06:45.168878 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52866) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:45.204472 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Request body: {'subnet': {'network_id': '9a6c905d-f0c9-4c01-8dcc-f31837172714', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1093594594-subnet', 'tenant_id': 'ea1a0242f4cf40fd9bd267013f65af40', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:45.214839 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f2f06074-91b5-4e5d-a5d2-9bc23585e128 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:45.227891 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:45.239343 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for subnet, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:45.243204 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Usage tracker for resource:subnet and tenant:ea1a0242f4cf40fd9bd267013f65af40 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:45.275981 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f2f06074-91b5-4e5d-a5d2-9bc23585e128 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:45.279481 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:45.289190 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Pushing event updated for resources: {'Network': ['ID=9a6c905d-f0c9-4c01-8dcc-f31837172714,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:45.302899 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Network 9a6c905d-f0c9-4c01-8dcc-f31837172714 details requested by agent ovs-agent-hv-cinder-76019 with host hv-cinder-76019 {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:06:45.304273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.520s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:45.306028 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:45.340908 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Checking segment: {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84111) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:06:45.341579 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Network hostable DHCP agents. Network: ee1c48e9-8681-4765-bc5b-bc0215d911a4, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84111) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 18:06:45.343374 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f2f06074-91b5-4e5d-a5d2-9bc23585e128 admin admin] Usage tracker for resource:security_group_rule and tenant:50246c37b1824f71bd024d234b4541ee is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:45.344882 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network 9a6c905d-f0c9-4c01-8dcc-f31837172714 details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:06:45.376902 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:45.413067 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Network ee1c48e9-8681-4765-bc5b-bc0215d911a4 is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84111) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 18:06:45.428397 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2f43211a-7773-487d-8b86-a136c7f7c156,revision_number=0']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:45.431690 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f2f06074-91b5-4e5d-a5d2-9bc23585e128 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:45.441159 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52878) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:45.442563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:45.455158 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f2f06074-91b5-4e5d-a5d2-9bc23585e128 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:45.496456 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, ee1c48e9-8681-4765-bc5b-bc0215d911a4) {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:06:45.497688 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:45.515104 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:45.516198 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:45.541439 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:45.551984 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for subnet, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:45.558284 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Made reservation on behalf of ea1a0242f4cf40fd9bd267013f65af40 for: {'subnet': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:45.563249 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Notify callbacks [] for subnet, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:45.596968 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b280094d-f4e4-4fdc-9c9d-d1a89c9eece9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:45.768667 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bb47604-31ad-43b6-a09c-92bd9bb66cdc None None] Network ee1c48e9-8681-4765-bc5b-bc0215d911a4 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:06:45.795487 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 2.7664537 Feb 17 18:06:45.831680 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:45.866007 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:45.871853 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] Usage tracker for resource:security_group_rule and tenant:3d5177ed54f745099edba15d031495cf is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:45.876773 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:45.884328 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:46.079542 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:46.108154 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2cd62965-11b1-462a-b682-0ec6c24ef98a,revision_number=0']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:46.127862 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.531s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:46.128504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10c812a6-9614-4796-afa3-639870765415 None None] Network ee1c48e9-8681-4765-bc5b-bc0215d911a4 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:06:46.128641 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:46.170359 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:46.243432 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] Synchronizing usage tracker for tenant:363eccccbf2e4380b1dde5c4b3f0ab4b on resource:security_group {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:06:46.275964 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dca741dc-e19d-46c3-87a6-d07e9bc911d7,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:46.288930 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:46.290891 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Checking segment: {'id': 'e39a606a-42ef-4057-9215-ad4d588cb178', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': 'd0113fdf-2728-4712-b5a7-48b6cde96686'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84111) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:06:46.291889 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Network hostable DHCP agents. Network: d0113fdf-2728-4712-b5a7-48b6cde96686, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84111) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 18:06:46.357068 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Checking segment: {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:06:46.357479 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Network hostable DHCP agents. Network: 8e56c377-33ba-47b0-9d75-fa2421d9f1e2, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84112) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 18:06:46.367439 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52908) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:46.372080 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Network d0113fdf-2728-4712-b5a7-48b6cde96686 is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84111) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 18:06:46.380034 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Feb 17 18:06:46.380716 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f2f06074-91b5-4e5d-a5d2-9bc23585e128 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:46.380907 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] Unset dirty status for tenant:363eccccbf2e4380b1dde5c4b3f0ab4b on resource:security_group {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:06:46.384706 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=3d5177ed54f745099edba15d031495cf&name=default HTTP/1.1" status: 200 len: 2975 time: 0.9400346 Feb 17 18:06:46.390868 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52912) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:46.451054 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f2f06074-91b5-4e5d-a5d2-9bc23585e128 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:46.460430 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, d0113fdf-2728-4712-b5a7-48b6cde96686) {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:06:46.465012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:46.469959 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:46.470195 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfd68045-4851-4c83-9f95-128859900cda None None] Network d0113fdf-2728-4712-b5a7-48b6cde96686 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:06:46.543727 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:46.550200 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84112) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 18:06:46.589788 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-8f8ba3a3-acf6-4bb7-b365-08ad15cb8a65 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:46.593204 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-8f8ba3a3-acf6-4bb7-b365-08ad15cb8a65 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/networks?id=ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 200 len: 815 time: 0.2242489 Feb 17 18:06:46.596067 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, 8e56c377-33ba-47b0-9d75-fa2421d9f1e2) {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:06:46.607993 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-7d4c22e6-f2cd-4c3c-9f24-443e8eacd6f9 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 2.2646623 Feb 17 18:06:46.610996 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:46.611660 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:46.626082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e81fc57d-bcb0-40d3-b3c8-778a69ff6e70 None None] Network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:06:46.631645 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f2f06074-91b5-4e5d-a5d2-9bc23585e128 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=50246c37b1824f71bd024d234b4541ee&name=default HTTP/1.1" status: 200 len: 2975 time: 1.7016764 Feb 17 18:06:46.642168 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52926) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:46.755593 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Allocated IP 172.27.1.160 (68fd415f-8606-43f8-b4d1-98e6a9c9af94/1c895d8f-55ff-4bdb-a323-742172b9934e/70c0b2b2-f638-4813-b2dc-4e6d89d13791) {{(pid=84112) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:06:46.776766 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2f06074-91b5-4e5d-a5d2-9bc23585e128 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0debacd1-eb83-4e2b-97c1-f295e0bfc0fd,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:46.789092 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1ce48b06-9cdf-47eb-bb86-c518fe399213 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:46.796240 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-ad6d1e56-9785-4ccf-8481-88301fc35918 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/quotas/c2e8792284c348238cf9afdcae0c221e HTTP/1.1" status: 200 len: 375 time: 0.1782184 Feb 17 18:06:46.804916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f2f06074-91b5-4e5d-a5d2-9bc23585e128 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:46.865308 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 3.5145860 Feb 17 18:06:46.872403 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 52940) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:46.884145 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94df7daa-eff1-4cdb-8e25-9bb34e374124 None None] Network d0113fdf-2728-4712-b5a7-48b6cde96686 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:06:46.886805 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:46.895997 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:46.900103 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Usage tracker for resource:router and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:46.904776 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:46.911803 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:46.921116 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-cc5b0fbd-6b63-4be8-be82-cf3df7c53e02 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1218090 Feb 17 18:06:46.928019 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1ce48b06-9cdf-47eb-bb86-c518fe399213 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:46.928999 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-23b893ca-ee8a-4abc-a74e-22ea57212c23 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:46.943207 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for subnet, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:46.962873 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-23b893ca-ee8a-4abc-a74e-22ea57212c23 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:46.969719 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-4f967b23-1b65-4d9a-ad46-60e9fc6c6c9d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:47.060776 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-395995', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-5288'] for router, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.064578 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-395820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036854319730', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request--9223372036853142595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider--9223372036854770544'] for router, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.070168 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.107358 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.175660 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a5b0cdf5-0893-43d1-8023-c370f1f6ab8c,revision_number=0']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:47.190169 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa801fd4f-d9d9-59b5-9186-1ec4edf3a9c6-8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156'}]}} from dv-cinder-760194-3-iscsi. {{(pid=84113) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Feb 17 18:06:47.191096 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.196686 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:47.216484 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-23b893ca-ee8a-4abc-a74e-22ea57212c23 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.233445 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Notify callbacks [] for port, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.262219 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d5031001-0e77-41e5-871a-0e25d2f258f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:47.278847 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1ce48b06-9cdf-47eb-bb86-c518fe399213 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.293854 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-23b893ca-ee8a-4abc-a74e-22ea57212c23 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.295835 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-23b893ca-ee8a-4abc-a74e-22ea57212c23 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0debacd1-eb83-4e2b-97c1-f295e0bfc0fd HTTP/1.1" status: 204 len: 168 time: 0.6526930 Feb 17 18:06:47.302527 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-7fac2824-d6e0-49f5-84e5-061a73047100 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=84111) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 17 18:06:47.310019 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f2f06074-91b5-4e5d-a5d2-9bc23585e128 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:47.312601 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-7fac2824-d6e0-49f5-84e5-061a73047100 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13455 time: 0.1137698 Feb 17 18:06:47.314861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23b893ca-ee8a-4abc-a74e-22ea57212c23 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0debacd1-eb83-4e2b-97c1-f295e0bfc0fd,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:47.327238 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-23b893ca-ee8a-4abc-a74e-22ea57212c23 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:47.340480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ce48b06-9cdf-47eb-bb86-c518fe399213 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dca741dc-e19d-46c3-87a6-d07e9bc911d7,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:47.348514 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1ce48b06-9cdf-47eb-bb86-c518fe399213 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:47.350244 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Checking segment: {'id': 'c2d54292-0536-4a70-b118-0e7d52b9d0a7', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '9a6c905d-f0c9-4c01-8dcc-f31837172714'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:06:47.350641 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Network hostable DHCP agents. Network: 9a6c905d-f0c9-4c01-8dcc-f31837172714, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84112) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 18:06:47.361728 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1ce48b06-9cdf-47eb-bb86-c518fe399213 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.362945 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-1ce48b06-9cdf-47eb-bb86-c518fe399213 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/dca741dc-e19d-46c3-87a6-d07e9bc911d7 HTTP/1.1" status: 204 len: 168 time: 0.9642904 Feb 17 18:06:47.423716 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.443166 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:47.561563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Network 9a6c905d-f0c9-4c01-8dcc-f31837172714 is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84112) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 18:06:47.611961 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Pushing event updated for resources: {'Port': ['ID=70c0b2b2-f638-4813-b2dc-4e6d89d13791,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:47.618215 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Allocated IP 172.20.0.2 (8e56c377-33ba-47b0-9d75-fa2421d9f1e2/2f43211a-7773-487d-8b86-a136c7f7c156/a953a5ed-ca95-4f85-b04b-1d799007693b) {{(pid=84113) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:06:47.620151 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:47.646279 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, 9a6c905d-f0c9-4c01-8dcc-f31837172714) {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:06:47.658981 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f7979cf-9e60-447b-8386-6e346a352e74 None None] Network 9a6c905d-f0c9-4c01-8dcc-f31837172714 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:06:47.663147 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:47.664101 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.777845 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:06:47.779375 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:06:47.786426 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Received port after_create {{(pid=84112) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:06:47.914715 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036854319563', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036854379843', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider--9223372036854770557'] for router, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:47.939153 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-c35fecd7-b3f3-427a-bf7f-1991bd71be0d service neutron] 10.222.0.13 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6252942 Feb 17 18:06:47.968781 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.7748311 Feb 17 18:06:48.068551 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52978) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:48.093153 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ed3b030-2886-46c2-b2f1-3a86369138c7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:48.112745 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:06:48.355379 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-9bbb4985-ca92-47bc-9320-0b04ffcfb24f service neutron] 10.222.0.13 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.4085968 Feb 17 18:06:48.376762 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Notify callbacks [] for port, precommit_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:48.387017 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0749b00d-5518-48dd-aa1c-995f67a11e03 None None] Network 9a6c905d-f0c9-4c01-8dcc-f31837172714 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:06:48.388046 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-3ed3b030-2886-46c2-b2f1-3a86369138c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:48.405360 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-3ed3b030-2886-46c2-b2f1-3a86369138c7 admin admin] Usage tracker for resource:security_group_rule and tenant:1510585a2fb44f2f8f32dff49baf82cb is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:48.424285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-3ed3b030-2886-46c2-b2f1-3a86369138c7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:48.426943 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 52984) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:48.461553 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-3ed3b030-2886-46c2-b2f1-3a86369138c7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:48.475854 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-01ca7997-40da-4b30-ad78-a946569c3357 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:48.494064 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:48.694517 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Transition to ACTIVE for port object a953a5ed-ca95-4f85-b04b-1d799007693b will not be triggered until provisioned by entity L2. {{(pid=84113) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:06:48.716091 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Transition to ACTIVE for port object a953a5ed-ca95-4f85-b04b-1d799007693b will not be triggered until provisioned by entity DHCP. {{(pid=84113) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:06:48.752730 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53002) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:48.788846 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:48.821321 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a652432c-347b-4c50-99d1-bd3f29df62d5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:48.830170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1460786013-network', 'tenant_id': '71a541d989bc494fbfa64e64c47d2209'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:48.835455 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:48.840463 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Usage tracker for resource:network and tenant:71a541d989bc494fbfa64e64c47d2209 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:48.843610 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:48.849848 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:48.882604 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53016) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:48.964998 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-01ca7997-40da-4b30-ad78-a946569c3357 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:48.976526 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-01ca7997-40da-4b30-ad78-a946569c3357 admin admin] Usage tracker for resource:security_group_rule and tenant:62a6611dc3b94be8b12d73265d903d58 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:48.982263 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Made reservation on behalf of 71a541d989bc494fbfa64e64c47d2209 for: {'network': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:48.987530 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:48.988538 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-01ca7997-40da-4b30-ad78-a946569c3357 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:49.004627 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-01ca7997-40da-4b30-ad78-a946569c3357 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:49.028662 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ad71914f-f486-4e76-abf8-9b718f8b23ef req-6f8eae80-55ff-4c5f-ab4f-d17ea8111162 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 210 time: 0.1446986 Feb 17 18:06:49.036802 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Pushing event updated for resources: {'Port': ['ID=a953a5ed-ca95-4f85-b04b-1d799007693b,revision_number=1']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:49.046447 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.104838 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:49.104969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.104969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.104969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.107230 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.107645 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.108071 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.108457 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.108839 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.109331 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.109785 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Usage tracker for resource:security_group_rule and tenant:71a541d989bc494fbfa64e64c47d2209 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:49.111391 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.111791 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.112201 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.112632 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.113012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.113524 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.113732 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.115202 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.115590 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.117045 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.117428 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.117809 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.118185 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.118557 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.118926 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:49.119388 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Tracked resource versions report: Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: pushed versions: Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: { 'AddressGroup': {'1.1'}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': {'1.0'}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': {'1.0'}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': {'1.1'}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': {'1.7'}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': {'1.2'}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': {'1.8'}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': {'1.4'}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': {'1.2'}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': {'1.0'}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': {'1.1'}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': {'1.1'}} Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: consumer versions: Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: { DHCP agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: L3 agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: Metadata agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: Metering agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: Open vSwitch agent@dv-cinder-760194-3-iscsi: { 'AddressGroup': '1.1', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': '1.0', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': '1.0', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': '1.1', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': '1.7', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': '1.2', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': '1.8', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': '1.4', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': '1.2', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': '1.0', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': '1.1', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': '1.1'}, Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: Open vSwitch agent@hv-cinder-76019: { 'AddressGroup': '1.1', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': '1.0', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': '1.0', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': '1.1', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': '1.7', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': '1.2', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': '1.8', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': '1.4', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': '1.2', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': '1.0', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': '1.1', Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': '1.1'}} Feb 17 18:06:49.124684 dv-cinder-760194-3-iscsi neutron-server[84000]: {{(pid=84113) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Feb 17 18:06:49.128582 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.135422 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.314s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:49.163127 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:49.177455 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.258273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 is already hosted by enough agents. {{(pid=84113) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:06:49.259512 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Resources bound (agent type, host, resource id): {{(pid=84113) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:06:49.265515 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Received port after_create {{(pid=84113) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:06:49.331927 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Attempting to bind port a953a5ed-ca95-4f85-b04b-1d799007693b on host dv-cinder-760194-3-iscsi for vnic_type normal with profile {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:06:49.332327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Attempting to bind port a953a5ed-ca95-4f85-b04b-1d799007693b by drivers openvswitch on host dv-cinder-760194-3-iscsi at level 0 using segments [{'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:06:49.332961 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Attempting to bind port a953a5ed-ca95-4f85-b04b-1d799007693b on network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:06:49.339222 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Checking agent: {'id': '3fdd9543-fb8c-4d73-992e-15dd132fbdf2', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760194-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'started_at': datetime.datetime(2021, 2, 17, 17, 58, 12), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 6, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760194-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.58', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:06:49.339639 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Checking segment: {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84113) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:06:49.340113 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.340557 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Bound using segment: {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:06:49.341643 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Bound port: a953a5ed-ca95-4f85-b04b-1d799007693b, host: dv-cinder-760194-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'}}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:06:49.342093 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.415011 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-01ca7997-40da-4b30-ad78-a946569c3357 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.440607 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create--9223372036854379860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-456206'] for router, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.445149 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ed3b030-2886-46c2-b2f1-3a86369138c7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.449175 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-01ca7997-40da-4b30-ad78-a946569c3357 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.460089 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-852022a2-b6e5-4282-a660-803da5705671 None None] For port a953a5ed-ca95-4f85-b04b-1d799007693b, host dv-cinder-760194-3-iscsi, cleared binding levels {{(pid=84113) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:06:49.464261 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-852022a2-b6e5-4282-a660-803da5705671 None None] For port a953a5ed-ca95-4f85-b04b-1d799007693b, host dv-cinder-760194-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=a953a5ed-ca95-4f85-b04b-1d799007693b,segment=NetworkSegment(a3b9a246-e8d6-47cc-bbb0-e0531b20a903),segment_id=a3b9a246-e8d6-47cc-bbb0-e0531b20a903)] {{(pid=84113) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:06:49.497674 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.517942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:49.601237 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-eb445603-7d44-452d-96ca-9af1144124fe tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:49.601995 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-eb445603-7d44-452d-96ca-9af1144124fe tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Synchronizing usage tracker for tenant:ea1a0242f4cf40fd9bd267013f65af40 on resource:network {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:06:49.641187 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-279a09a9-5806-4160-bdb7-7d6219bbea4b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:49.670124 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ed3b030-2886-46c2-b2f1-3a86369138c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.688535 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Pushing event updated for resources: {'Port': ['ID=a953a5ed-ca95-4f85-b04b-1d799007693b,revision_number=2']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:49.692879 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.696439 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-01ca7997-40da-4b30-ad78-a946569c3357 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=62a6611dc3b94be8b12d73265d903d58&name=default HTTP/1.1" status: 200 len: 2978 time: 1.2683794 Feb 17 18:06:49.697207 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53046) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:49.704864 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:49.720415 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Allocated IP 172.27.1.123 (68fd415f-8606-43f8-b4d1-98e6a9c9af94/1c895d8f-55ff-4bdb-a323-742172b9934e/03f689c4-eeed-4472-ab9d-f14a0929a430) {{(pid=84111) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:06:49.735920 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.740641 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:49.743824 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01ca7997-40da-4b30-ad78-a946569c3357 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3b1fc99-aba3-415a-a6d9-d095ae9e1e6c,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:49.752965 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-01ca7997-40da-4b30-ad78-a946569c3357 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:49.755912 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.047s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:49.767669 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-eb445603-7d44-452d-96ca-9af1144124fe tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Unset dirty status for tenant:ea1a0242f4cf40fd9bd267013f65af40 on resource:network {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:06:49.769208 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-eb445603-7d44-452d-96ca-9af1144124fe tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/networks?id=9a6c905d-f0c9-4c01-8dcc-f31837172714 HTTP/1.1" status: 200 len: 812 time: 0.4894261 Feb 17 18:06:49.774231 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e07ef398-1650-4d39-ae5c-a61272e8b63c,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:49.778199 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:49.791843 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-b5dff115-55b4-4853-9115-712915c2d25e tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/quotas/ea1a0242f4cf40fd9bd267013f65af40 HTTP/1.1" status: 200 len: 375 time: 0.0111232 Feb 17 18:06:49.807029 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3ed3b030-2886-46c2-b2f1-3a86369138c7 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1510585a2fb44f2f8f32dff49baf82cb&name=default HTTP/1.1" status: 200 len: 2975 time: 1.7375822 Feb 17 18:06:49.808740 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ed3b030-2886-46c2-b2f1-3a86369138c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6273982-c030-4b27-b5c9-826df3a41c05,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:49.816169 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53050) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:49.821619 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3ed3b030-2886-46c2-b2f1-3a86369138c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:49.881105 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] vxlan segment allocate from pool success with {'vxlan_vni': 8} {{(pid=84111) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:151}} Feb 17 18:06:49.924459 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b969f172-5ea5-4c55-bda5-976525adb41a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.952856 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-ec57fc7c-16e4-4c89-8bb8-d0eaa4e79cf0 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=ea1a0242f4cf40fd9bd267013f65af40&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1375551 Feb 17 18:06:49.963714 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b969f172-5ea5-4c55-bda5-976525adb41a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.967628 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:49.968052 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Added segment d1933c99-d69f-40e4-a095-182836e6ad6b of type vxlan for network 18109d6a-747c-4258-bd9e-533efa016ff4 Feb 17 18:06:50.006873 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4b0a0571-a6fc-478b-8ace-f60c8bfec371 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:50.100754 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4b0a0571-a6fc-478b-8ace-f60c8bfec371 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:50.151623 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Router 753da3f7-eb03-4d22-b4aa-61cd56b0892f is scheduled to L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b with binding_index 1 {{(pid=84112) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:214}} Feb 17 18:06:50.190342 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1b484aa6-ee37-4f20-90b3-567a58dadbea req-0646a2ff-864e-4c9d-b6ca-f65b7da5086a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 210 time: 0.0968485 Feb 17 18:06:50.264252 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Notify callbacks [] for port, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:50.268549 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:50.292901 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-ca25708e-0e41-482b-b180-78dde198b81a service neutron] 10.222.0.13 "GET /v2.0/networks/9a6c905d-f0c9-4c01-8dcc-f31837172714?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3292460 Feb 17 18:06:50.408563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device a953a5ed-ca95-4f85-b04b-1d799007693b up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:06:50.428830 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84112) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:06:50.445147 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Sync routers for ids ['753da3f7-eb03-4d22-b4aa-61cd56b0892f'] in dv-cinder-760194-3-iscsi {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:06:50.464578 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Routers {'753da3f7-eb03-4d22-b4aa-61cd56b0892f'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:06:50.473158 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:50.473305 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:06:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['753da3f7-eb03-4d22-b4aa-61cd56b0892f'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:06:50.473422 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:50.473422 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:50.483504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:50.511923 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:50.535327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Notify callbacks [] for router, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:50.539426 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 7.0738716 Feb 17 18:06:50.539753 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53072) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:50.553371 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning for port a953a5ed-ca95-4f85-b04b-1d799007693b completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:06:50.593897 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-51f39e49-1b7c-4d17-b42e-2d5b97be7e3b service neutron] 10.222.0.13 "GET /v2.0/networks/9a6c905d-f0c9-4c01-8dcc-f31837172714?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2999828 Feb 17 18:06:50.722552 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Pushing event updated for resources: {'Network': ['ID=18109d6a-747c-4258-bd9e-533efa016ff4,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:50.725615 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:50.728191 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.145s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:50.735111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Network 18109d6a-747c-4258-bd9e-533efa016ff4 details requested by agent ovs-agent-hv-cinder-76019 with host hv-cinder-76019 {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:06:50.747020 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4b0a0571-a6fc-478b-8ace-f60c8bfec371 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:50.747806 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b969f172-5ea5-4c55-bda5-976525adb41a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:50.749962 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Set router 753da3f7-eb03-4d22-b4aa-61cd56b0892f gateway port host: dv-cinder-760194-3-iscsi {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:06:50.757506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:50.775508 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b969f172-5ea5-4c55-bda5-976525adb41a admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:50.779386 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-b969f172-5ea5-4c55-bda5-976525adb41a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b3b1fc99-aba3-415a-a6d9-d095ae9e1e6c HTTP/1.1" status: 204 len: 168 time: 1.0669658 Feb 17 18:06:50.780800 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4b0a0571-a6fc-478b-8ace-f60c8bfec371 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:50.785206 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-4b0a0571-a6fc-478b-8ace-f60c8bfec371 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a6273982-c030-4b27-b5c9-826df3a41c05 HTTP/1.1" status: 204 len: 168 time: 0.9681602 Feb 17 18:06:50.786635 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b0a0571-a6fc-478b-8ace-f60c8bfec371 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6273982-c030-4b27-b5c9-826df3a41c05,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:50.803917 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b969f172-5ea5-4c55-bda5-976525adb41a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3b1fc99-aba3-415a-a6d9-d095ae9e1e6c,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:50.811910 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b969f172-5ea5-4c55-bda5-976525adb41a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:50.813051 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.033s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:50.814306 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:50.864694 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network 18109d6a-747c-4258-bd9e-533efa016ff4 details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:06:51.184586 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 2.4306884 Feb 17 18:06:51.187715 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53102) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:51.194548 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Request body: {'subnet': {'network_id': '18109d6a-747c-4258-bd9e-533efa016ff4', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1460786013-subnet', 'tenant_id': '71a541d989bc494fbfa64e64c47d2209', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:51.214155 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:51.218487 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Usage tracker for resource:subnet and tenant:71a541d989bc494fbfa64e64c47d2209 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:51.224335 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:51.231371 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:51.293899 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-95068154-edd9-412b-8dc8-a798fb10e914 req-ce0c758d-c023-469c-9cea-fe5894269ece tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 210 time: 0.1128979 Feb 17 18:06:51.294836 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Pushing event updated for resources: {'Port': ['ID=03f689c4-eeed-4472-ab9d-f14a0929a430,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:51.316869 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.589s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:51.354323 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 is already hosted by enough agents. {{(pid=84111) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:06:51.355600 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Resources bound (agent type, host, resource id): {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:06:51.362626 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Received port after_create {{(pid=84111) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:06:51.399107 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Made reservation on behalf of 71a541d989bc494fbfa64e64c47d2209 for: {'subnet': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:51.407434 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Notify callbacks [] for subnet, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:51.410361 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'name': 'tempest-ServerRescueNegativeTestJSON-1294029612-router', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160'}], 'enable_snat': True}, 'gw_port_id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:43Z', 'updated_at': '2021-02-17T18:06:48Z', 'revision_number': 3, 'project_id': 'bda7a35e855840d7bc75e16e402f3690', 'gw_port': {'id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:8a:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:46Z', 'updated_at': '2021-02-17T18:06:46Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi'}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:06:51.418786 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Checking router: 753da3f7-eb03-4d22-b4aa-61cd56b0892f for host: dv-cinder-760194-3-iscsi {{(pid=84114) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:06:51.420895 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Updating router 753da3f7-eb03-4d22-b4aa-61cd56b0892f port 70c0b2b2-f638-4813-b2dc-4e6d89d13791 binding host dv-cinder-760194-3-iscsi {{(pid=84114) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:208}} Feb 17 18:06:51.541195 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:51.761368 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c127b78-df4b-4309-bc8a-f8851df3b3d8 None None] Network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:06:51.769436 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1934dfdf-42f0-464a-8d77-9d3118066f53 req-63ed2407-befe-4909-bb4f-4906e9ad39c7 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 210 time: 0.1994145 Feb 17 18:06:52.199653 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-a6afb838-9479-4da1-9d0f-5a2708403dcb None None] Provisioning for port a953a5ed-ca95-4f85-b04b-1d799007693b completed by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:06:52.244019 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-a6afb838-9479-4da1-9d0f-5a2708403dcb None None] Provisioning complete for port a953a5ed-ca95-4f85-b04b-1d799007693b triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:06:52.244484 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a6afb838-9479-4da1-9d0f-5a2708403dcb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:52.461065 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Notify callbacks [] for port, precommit_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:52.492370 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Transition to ACTIVE for port object 70c0b2b2-f638-4813-b2dc-4e6d89d13791 will not be triggered until provisioned by entity L2. {{(pid=84114) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:06:52.525506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:52.628397 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1af0ed54-dce6-4427-9b87-1d86276ccc98 req-b89d1c87-c253-4d8a-b9be-c7d87f93e7f0 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 210 time: 0.2087927 Feb 17 18:06:52.664547 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a6afb838-9479-4da1-9d0f-5a2708403dcb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:52.732684 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:52.749417 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:52.839780 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-a6afb838-9479-4da1-9d0f-5a2708403dcb None None] For port a953a5ed-ca95-4f85-b04b-1d799007693b, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=a953a5ed-ca95-4f85-b04b-1d799007693b,segment=NetworkSegment(a3b9a246-e8d6-47cc-bbb0-e0531b20a903),segment_id=a3b9a246-e8d6-47cc-bbb0-e0531b20a903)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:06:52.890827 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a6afb838-9479-4da1-9d0f-5a2708403dcb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:52.893097 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:52.956013 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Pushing event updated for resources: {'Port': ['ID=70c0b2b2-f638-4813-b2dc-4e6d89d13791,revision_number=2']} {{(pid=84114) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:52.975436 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.976073 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.976598 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.977115 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.977626 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.978137 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.978663 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.979726 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.980257 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.980762 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.981289 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.981804 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.982353 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.982859 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.983363 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.983882 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.984408 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.984912 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.985412 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.985916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.986432 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.986938 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.987625 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.988147 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Tracked resource versions report: Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: pushed versions: Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: { 'AddressGroup': {'1.1'}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': {'1.0'}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': {'1.0'}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': {'1.1'}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': {'1.7'}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': {'1.2'}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': {'1.8'}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': {'1.4'}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': {'1.2'}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': {'1.0'}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': {'1.1'}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': {'1.1'}} Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: consumer versions: Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: { DHCP agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: L3 agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: Metadata agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: Metering agent@dv-cinder-760194-3-iscsi: {}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: Open vSwitch agent@dv-cinder-760194-3-iscsi: { 'AddressGroup': '1.1', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': '1.0', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': '1.0', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': '1.1', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': '1.7', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': '1.2', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': '1.8', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': '1.4', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': '1.2', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': '1.0', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': '1.1', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': '1.1'}, Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: Open vSwitch agent@hv-cinder-76019: { 'AddressGroup': '1.1', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'ConntrackHelper': '1.0', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Log': '1.0', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Network': '1.1', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Port': '1.7', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'PortForwarding': '1.2', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'QosPolicy': '1.8', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroup': '1.4', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SecurityGroupRule': '1.2', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'SubPort': '1.0', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Subnet': '1.1', Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: 'Trunk': '1.1'}} Feb 17 18:06:52.989847 dv-cinder-760194-3-iscsi neutron-server[84000]: {{(pid=84114) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:178}} Feb 17 18:06:53.012207 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:53.065724 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Attempting to bind port 70c0b2b2-f638-4813-b2dc-4e6d89d13791 on host dv-cinder-760194-3-iscsi for vnic_type normal with profile {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:06:53.066080 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Attempting to bind port 70c0b2b2-f638-4813-b2dc-4e6d89d13791 by drivers openvswitch on host dv-cinder-760194-3-iscsi at level 0 using segments [{'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}] {{(pid=84114) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:06:53.066480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Attempting to bind port 70c0b2b2-f638-4813-b2dc-4e6d89d13791 on network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:06:53.074299 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Checking agent: {'id': '3fdd9543-fb8c-4d73-992e-15dd132fbdf2', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760194-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'started_at': datetime.datetime(2021, 2, 17, 17, 58, 12), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 6, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760194-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.58', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:06:53.074709 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Checking segment: {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84114) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:06:53.075151 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:53.075576 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Bound using segment: {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'} {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:06:53.076108 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Bound port: 70c0b2b2-f638-4813-b2dc-4e6d89d13791, host: dv-cinder-760194-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}}] {{(pid=84114) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:06:53.076576 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:53.130349 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.70', 63957) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:53.141770 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-3f091ef4-884c-4931-b0ff-c07dab6df0a6 None None] Provisioning complete for port a953a5ed-ca95-4f85-b04b-1d799007693b triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:06:53.146961 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3f091ef4-884c-4931-b0ff-c07dab6df0a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:53.226222 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] For port 70c0b2b2-f638-4813-b2dc-4e6d89d13791, host dv-cinder-760194-3-iscsi, cleared binding levels {{(pid=84114) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:06:53.232521 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] For port 70c0b2b2-f638-4813-b2dc-4e6d89d13791, host dv-cinder-760194-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=70c0b2b2-f638-4813-b2dc-4e6d89d13791,segment=NetworkSegment(b5e97d06-6722-4de8-9658-658adc74c7b4),segment_id=b5e97d06-6722-4de8-9658-658adc74c7b4)] {{(pid=84114) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:06:53.275553 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6afb838-9479-4da1-9d0f-5a2708403dcb None None] Pushing event updated for resources: {'Port': ['ID=a953a5ed-ca95-4f85-b04b-1d799007693b,revision_number=3']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:53.300449 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:53.311962 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a6afb838-9479-4da1-9d0f-5a2708403dcb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.419s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:53.351580 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-408f7037-0d53-4a2f-b404-28e5dfeb6241 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:53.506158 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:53.606436 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-15da6b77-e960-4df0-bb4c-ee98c9c25632 None None] Provisioning complete for port a953a5ed-ca95-4f85-b04b-1d799007693b triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:06:53.606869 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-15da6b77-e960-4df0-bb4c-ee98c9c25632 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:53.687407 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Pushing event updated for resources: {'Port': ['ID=70c0b2b2-f638-4813-b2dc-4e6d89d13791,revision_number=3']} {{(pid=84114) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:53.702826 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.351s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:53.785677 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Routers {'753da3f7-eb03-4d22-b4aa-61cd56b0892f'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:06:53.786361 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:06:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['753da3f7-eb03-4d22-b4aa-61cd56b0892f'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:06:53.857189 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-025d5e5d-f2b3-471e-971c-b4b8c0ef6d2b req-bcfa87e5-c38e-4eff-92d7-eaf202011d15 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 210 time: 0.7083371 Feb 17 18:06:53.966738 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-fc9c3934-236c-4adf-b7df-bb0d9036cdb8 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:53.967526 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-fc9c3934-236c-4adf-b7df-bb0d9036cdb8 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Synchronizing usage tracker for tenant:c2e8792284c348238cf9afdcae0c221e on resource:network {{(pid=84112) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:06:54.029867 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create--9223372036854379860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-456206'] for router, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:54.159141 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-fc9c3934-236c-4adf-b7df-bb0d9036cdb8 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Unset dirty status for tenant:c2e8792284c348238cf9afdcae0c221e on resource:network {{(pid=84112) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:06:54.160427 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-fc9c3934-236c-4adf-b7df-bb0d9036cdb8 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "GET /v2.0/networks?id=ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 200 len: 815 time: 1.0234094 Feb 17 18:06:54.209697 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] Set router 753da3f7-eb03-4d22-b4aa-61cd56b0892f gateway port host: dv-cinder-760194-3-iscsi {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:06:54.271159 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Request body: {'port': {'device_id': 'b8ff9d7a-1f7b-42c0-b8d1-1f882378df53', 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4', 'admin_state_up': True, 'tenant_id': 'c2e8792284c348238cf9afdcae0c221e'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:54.300784 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f6a6731e-fa06-46ad-a85e-a867a77be888 req-524a492d-6870-47f7-b2b3-f113afbd7559 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 210 time: 0.0747731 Feb 17 18:06:54.348914 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device a953a5ed-ca95-4f85-b04b-1d799007693b up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:06:54.417633 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 is scheduled to L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b with binding_index 1 {{(pid=84111) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:214}} Feb 17 18:06:54.499194 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port a953a5ed-ca95-4f85-b04b-1d799007693b triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:06:54.499651 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:54.507381 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:54.512701 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Usage tracker for resource:port and tenant:c2e8792284c348238cf9afdcae0c221e is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:54.516756 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Quota usage for port was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:54.524109 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:54.656728 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Made reservation on behalf of c2e8792284c348238cf9afdcae0c221e for: {'port': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:54.663469 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:54.731605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for subnet, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:54.858874 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.70', 63963) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:55.033049 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:55.184982 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'name': 'tempest-ServerRescueNegativeTestJSON-1294029612-router', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160'}], 'enable_snat': True}, 'gw_port_id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:43Z', 'updated_at': '2021-02-17T18:06:48Z', 'revision_number': 3, 'project_id': 'bda7a35e855840d7bc75e16e402f3690', 'gw_port': {'id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:8a:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:46Z', 'updated_at': '2021-02-17T18:06:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi'}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:06:55.191609 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a82dc7e-c7bb-4df9-b2ff-aa8f28186410 None None] The sync data for ids ['753da3f7-eb03-4d22-b4aa-61cd56b0892f'] in dv-cinder-760194-3-iscsi is: [{'id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'name': 'tempest-ServerRescueNegativeTestJSON-1294029612-router', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160'}], 'enable_snat': True}, 'gw_port_id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:43Z', 'updated_at': '2021-02-17T18:06:48Z', 'revision_number': 3, 'project_id': 'bda7a35e855840d7bc75e16e402f3690', 'gw_port': {'id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:8a:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:46Z', 'updated_at': '2021-02-17T18:06:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi'}] {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:06:55.245981 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53254) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:55.268661 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ea6eb38a-5199-45bc-a83a-e25a2934861b,revision_number=0']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:55.285067 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:55.298480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Allocated IP 172.20.0.1 (4aaf4a03-4480-421f-bff4-f9814e969001/c04f01da-1295-4b8a-95ae-46589cb07040/780be217-eb0a-4e51-a67c-6d7f3345b156) {{(pid=84112) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:06:55.531688 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-916b9565-c5e2-4b75-a055-f67018462462 req-74043fab-02c8-4d58-b423-326f94e7104c tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 210 time: 0.0863612 Feb 17 18:06:55.531688 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84111) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:06:55.534015 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Sync routers for ids ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'] in dv-cinder-760194-3-iscsi {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:06:55.534015 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Routers {'26ce0b68-6f29-498d-8e7d-e9fdae0ac663'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:06:55.534015 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:06:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:06:55.535412 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-9e32fb9f-e70c-4419-856d-6e0a999cf09b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:55.535412 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-9e32fb9f-e70c-4419-856d-6e0a999cf09b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.70 "GET /v2.0/networks?id=9a6c905d-f0c9-4c01-8dcc-f31837172714 HTTP/1.1" status: 200 len: 812 time: 0.5673258 Feb 17 18:06:55.535412 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Request body: {'port': {'device_id': '0acf3623-ba41-4c0a-9078-ebe03ab82af3', 'network_id': '9a6c905d-f0c9-4c01-8dcc-f31837172714', 'admin_state_up': True, 'tenant_id': 'ea1a0242f4cf40fd9bd267013f65af40'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:55.667425 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Notify callbacks [] for router, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:55.668689 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 8.7871079 Feb 17 18:06:55.700204 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53274) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:55.735620 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:55.778807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Usage tracker for resource:port and tenant:ea1a0242f4cf40fd9bd267013f65af40 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:55.788103 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5d65269d-42ce-4656-ac5a-5c9d5c3d4724 req-35f85a01-7258-4213-9b27-71bcab9827e5 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 210 time: 0.1200933 Feb 17 18:06:55.789112 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Quota usage for port was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:55.808771 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:55.837430 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Set router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:06:55.869372 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Made reservation on behalf of ea1a0242f4cf40fd9bd267013f65af40 for: {'port': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:06:55.875767 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:56.367104 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Notify callbacks [] for port, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:56.408482 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Checking segment: {'id': 'd1933c99-d69f-40e4-a095-182836e6ad6b', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 8, 'network_id': '18109d6a-747c-4258-bd9e-533efa016ff4'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:06:56.414776 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-91ed150d-7cd7-4acc-bf44-d7fef03f6ebc admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:56.428941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Network hostable DHCP agents. Network: 18109d6a-747c-4258-bd9e-533efa016ff4, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84112) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 18:06:56.478274 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 70c0b2b2-f638-4813-b2dc-4e6d89d13791 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:06:56.510175 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-91ed150d-7cd7-4acc-bf44-d7fef03f6ebc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:06:56.583786 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-91ed150d-7cd7-4acc-bf44-d7fef03f6ebc admin admin] Usage tracker for resource:security_group_rule and tenant:b44275ef81764b08b806341699890916 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:06:56.589176 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-91ed150d-7cd7-4acc-bf44-d7fef03f6ebc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:06:56.609974 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-91ed150d-7cd7-4acc-bf44-d7fef03f6ebc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:06:56.672504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Network 18109d6a-747c-4258-bd9e-533efa016ff4 is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84112) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 18:06:56.729778 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8e7423eb-e4af-4353-ac9e-0def9222e59e req-7ff0b66e-56d2-4226-8db4-847ac3ae93d7 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 210 time: 0.0908539 Feb 17 18:06:56.833557 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, 18109d6a-747c-4258-bd9e-533efa016ff4) {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:06:56.848077 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Allocated IP 172.20.0.2 (9a6c905d-f0c9-4c01-8dcc-f31837172714/a5b0cdf5-0893-43d1-8023-c370f1f6ab8c/703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a) {{(pid=84111) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:06:56.893284 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ff1f292-10c9-4fe3-a380-cba10babcd35 None None] Network 18109d6a-747c-4258-bd9e-533efa016ff4 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:06:56.921692 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:56.921692 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:56.991277 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-91ed150d-7cd7-4acc-bf44-d7fef03f6ebc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:57.063817 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-91ed150d-7cd7-4acc-bf44-d7fef03f6ebc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:57.176749 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-94107073-7554-40f9-8641-90ec1acd16ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:57.197462 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-91ed150d-7cd7-4acc-bf44-d7fef03f6ebc admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b44275ef81764b08b806341699890916&name=default HTTP/1.1" status: 200 len: 2979 time: 1.9469743 Feb 17 18:06:57.200700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53304) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:57.217959 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning for port 70c0b2b2-f638-4813-b2dc-4e6d89d13791 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:06:57.240385 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 70c0b2b2-f638-4813-b2dc-4e6d89d13791 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:06:57.245175 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:57.346708 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-38b4620b-c733-4a6b-84fd-d3b7a61eb8a9 req-5aba9ce4-2782-47ac-9435-52ba0302b734 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 210 time: 0.1803379 Feb 17 18:06:57.464903 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91ed150d-7cd7-4acc-bf44-d7fef03f6ebc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c0cd1bd-e7c3-4528-b903-7e240c404af5,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:57.475086 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:06:51Z', 'revision_number': 3, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:06:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi'}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:06:57.484212 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba8e12d1-30ad-4776-92c3-c11884e0ff80 None None] Network 18109d6a-747c-4258-bd9e-533efa016ff4 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:06:57.484563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-91ed150d-7cd7-4acc-bf44-d7fef03f6ebc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:57.509893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3338c888-0a5a-4608-b089-0fde74e3d56b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:57.575564 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3338c888-0a5a-4608-b089-0fde74e3d56b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:57.627975 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-88007966-86ec-4fb5-82d9-4e26775dcb34 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 6.4300840 Feb 17 18:06:57.669164 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Notify callbacks [] for port, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:57.805621 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:57.808720 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Checking router: 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 for host: dv-cinder-760194-3-iscsi {{(pid=84113) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:06:57.809131 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Updating router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 port 03f689c4-eeed-4472-ab9d-f14a0929a430 binding host dv-cinder-760194-3-iscsi {{(pid=84113) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:208}} Feb 17 18:06:57.830363 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:57.992354 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:58.000965 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:58.005805 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Pushing event updated for resources: {'Port': ['ID=703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:58.036524 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:58.053062 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3ac35b9c-bd8c-4b81-91b4-5540189c54eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:58.061146 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53320) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:06:58.169007 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.339s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:58.193090 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] For port 70c0b2b2-f638-4813-b2dc-4e6d89d13791, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=70c0b2b2-f638-4813-b2dc-4e6d89d13791,segment=NetworkSegment(b5e97d06-6722-4de8-9658-658adc74c7b4),segment_id=b5e97d06-6722-4de8-9658-658adc74c7b4)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:06:58.225751 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Pushing event updated for resources: {'Port': ['ID=780be217-eb0a-4e51-a67c-6d7f3345b156,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:58.262761 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:58.300153 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f722700d-1a56-435d-a935-e1ec7054910c req-d18e0073-9cd7-4762-acf1-8a47d6a696de tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 210 time: 0.2510827 Feb 17 18:06:58.311910 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.259s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:58.335108 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Network 9a6c905d-f0c9-4c01-8dcc-f31837172714 is already hosted by enough agents. {{(pid=84111) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:06:58.339783 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Resources bound (agent type, host, resource id): {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:06:58.344414 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Received port after_create {{(pid=84111) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:06:58.359181 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:58.359181 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:58.373071 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Network 4aaf4a03-4480-421f-bff4-f9814e969001 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:06:58.376766 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:06:58.381233 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Received port after_create {{(pid=84112) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:06:58.381703 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036854376681'] for router_interface, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:58.439373 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_v2 [None req-0a296b78-8525-46d2-995f-937a50fbc8bf admin admin] Deleting subnet 2cd62965-11b1-462a-b682-0ec6c24ef98a {{(pid=84111) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1041}} Feb 17 18:06:58.445177 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0a296b78-8525-46d2-995f-937a50fbc8bf admin admin] Notify callbacks [] for subnet, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:58.488871 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.0371418 Feb 17 18:06:58.495771 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3338c888-0a5a-4608-b089-0fde74e3d56b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:58.505188 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:58.511954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3338c888-0a5a-4608-b089-0fde74e3d56b admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:58.513369 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3338c888-0a5a-4608-b089-0fde74e3d56b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/4c0cd1bd-e7c3-4528-b903-7e240c404af5 HTTP/1.1" status: 204 len: 168 time: 1.2992234 Feb 17 18:06:58.532715 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-d4acae53-c2b1-4089-bb0f-e67a7a8f0ce7 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=84111) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 17 18:06:58.534936 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-d4acae53-c2b1-4089-bb0f-e67a7a8f0ce7 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13455 time: 0.0306411 Feb 17 18:06:58.538308 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:06:58.562080 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Allocated IP 172.20.0.11 (ee1c48e9-8681-4765-bc5b-bc0215d911a4/e1b65f5a-677d-4368-874f-50623d3454b9/b3a26ef4-a85c-4cec-a049-f4b7fa8c6375) {{(pid=84112) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:06:58.585324 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3338c888-0a5a-4608-b089-0fde74e3d56b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c0cd1bd-e7c3-4528-b903-7e240c404af5,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:58.601830 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3338c888-0a5a-4608-b089-0fde74e3d56b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:58.608909 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0a296b78-8525-46d2-995f-937a50fbc8bf admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:58.614059 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Pushing event updated for resources: {'Port': ['ID=70c0b2b2-f638-4813-b2dc-4e6d89d13791,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:06:58.633227 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:06:58.644611 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0a296b78-8525-46d2-995f-937a50fbc8bf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1550982'] for subnet, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:59.301218 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:59.316395 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Request body: {'port': {'device_id': '0acf3623-ba41-4c0a-9078-ebe03ab82af3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:06:59.369220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:59.514747 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Notify callbacks [] for port, precommit_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:59.539617 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Transition to ACTIVE for port object 03f689c4-eeed-4472-ab9d-f14a0929a430 will not be triggered until provisioned by entity L2. {{(pid=84113) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:06:59.583245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d6b14ad-9833-41ee-ae24-aa2a8b478ba0 req-467a470d-c71b-4dac-99d2-4f3b3701eb2e tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:06:59.584673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-1d6b14ad-9833-41ee-ae24-aa2a8b478ba0 req-467a470d-c71b-4dac-99d2-4f3b3701eb2e tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Synchronizing usage tracker for tenant:ea1a0242f4cf40fd9bd267013f65af40 on resource:port {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:06:59.639655 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:59.890423 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:06:59.914177 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:00.077878 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a35fdfc-3d7d-4e63-a298-77456e578c9a None None] Pushing event updated for resources: {'Port': ['ID=03f689c4-eeed-4472-ab9d-f14a0929a430,revision_number=2']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:00.096906 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-1d6b14ad-9833-41ee-ae24-aa2a8b478ba0 req-467a470d-c71b-4dac-99d2-4f3b3701eb2e tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Unset dirty status for tenant:ea1a0242f4cf40fd9bd267013f65af40 on resource:port {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:07:00.098215 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1d6b14ad-9833-41ee-ae24-aa2a8b478ba0 req-467a470d-c71b-4dac-99d2-4f3b3701eb2e tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 931 time: 1.2853272 Feb 17 18:07:00.111969 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a0a8b2de-fd8a-4754-b80e-9d6962b6b583 req-d4e7c338-e429-4876-815f-a2568a69365a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 210 time: 0.3492336 Feb 17 18:07:00.125831 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-4a35fdfc-3d7d-4e63-a298-77456e578c9a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:00.197651 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Attempting to bind port 03f689c4-eeed-4472-ab9d-f14a0929a430 on host dv-cinder-760194-3-iscsi for vnic_type normal with profile {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:07:00.198065 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Attempting to bind port 03f689c4-eeed-4472-ab9d-f14a0929a430 by drivers openvswitch on host dv-cinder-760194-3-iscsi at level 0 using segments [{'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:07:00.198514 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Attempting to bind port 03f689c4-eeed-4472-ab9d-f14a0929a430 on network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:07:00.227143 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Checking agent: {'id': '3fdd9543-fb8c-4d73-992e-15dd132fbdf2', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760194-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'started_at': datetime.datetime(2021, 2, 17, 17, 58, 12), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 6, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760194-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.58', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:07:00.227567 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Checking segment: {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84113) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:07:00.228078 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:00.228519 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Bound using segment: {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:07:00.229587 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Bound port: 03f689c4-eeed-4472-ab9d-f14a0929a430, host: dv-cinder-760194-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:07:00.230024 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:00.381528 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0a296b78-8525-46d2-995f-937a50fbc8bf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853224802', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for subnet, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:00.410596 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] For port 03f689c4-eeed-4472-ab9d-f14a0929a430, host dv-cinder-760194-3-iscsi, cleared binding levels {{(pid=84113) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:07:00.432688 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] For port 03f689c4-eeed-4472-ab9d-f14a0929a430, host dv-cinder-760194-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=03f689c4-eeed-4472-ab9d-f14a0929a430,segment=NetworkSegment(b5e97d06-6722-4de8-9658-658adc74c7b4),segment_id=b5e97d06-6722-4de8-9658-658adc74c7b4)] {{(pid=84113) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:07:00.452464 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 70c0b2b2-f638-4813-b2dc-4e6d89d13791 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:00.627708 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:00.643483 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-2126446e-b49a-4a73-bab4-c66fad1a849c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:00.646822 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:00.734687 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-1d6b14ad-9833-41ee-ae24-aa2a8b478ba0 req-f69bb4fb-15cf-4be7-a0fd-d9675d89a1a4 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Synchronizing usage tracker for tenant:ea1a0242f4cf40fd9bd267013f65af40 on resource:security_group {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:07:00.817411 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks [] for port, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:00.962713 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a35fdfc-3d7d-4e63-a298-77456e578c9a None None] Pushing event updated for resources: {'Port': ['ID=03f689c4-eeed-4472-ab9d-f14a0929a430,revision_number=3']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:00.975728 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-4a35fdfc-3d7d-4e63-a298-77456e578c9a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:01.004098 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 70c0b2b2-f638-4813-b2dc-4e6d89d13791 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:01.004531 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:01.183156 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:01.251016 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Routers {'26ce0b68-6f29-498d-8e7d-e9fdae0ac663'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:07:01.251824 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:06:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:01.279721 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a296b78-8525-46d2-995f-937a50fbc8bf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2cd62965-11b1-462a-b682-0ec6c24ef98a,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:01.285249 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-1d6b14ad-9833-41ee-ae24-aa2a8b478ba0 req-f69bb4fb-15cf-4be7-a0fd-d9675d89a1a4 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Unset dirty status for tenant:ea1a0242f4cf40fd9bd267013f65af40 on resource:security_group {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:07:01.290740 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1d6b14ad-9833-41ee-ae24-aa2a8b478ba0 req-f69bb4fb-15cf-4be7-a0fd-d9675d89a1a4 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.1266880 Feb 17 18:07:01.324736 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0a296b78-8525-46d2-995f-937a50fbc8bf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.683s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:01.505349 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Allocated IP 172.20.0.1 (8e56c377-33ba-47b0-9d75-fa2421d9f1e2/2f43211a-7773-487d-8b86-a136c7f7c156/3837ab39-c6c1-4f34-9b6b-47c98bdea645) {{(pid=84112) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:07:01.515273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0a296b78-8525-46d2-995f-937a50fbc8bf admin admin] Notify callbacks [] for subnet, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:01.539086 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:01.720822 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] Set router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:07:01.792992 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Network ee1c48e9-8681-4765-bc5b-bc0215d911a4 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:07:01.817365 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-0a296b78-8525-46d2-995f-937a50fbc8bf admin admin] 10.222.0.13 "DELETE /v2.0/subnets/2cd62965-11b1-462a-b682-0ec6c24ef98a HTTP/1.1" status: 204 len: 168 time: 3.6423824 Feb 17 18:07:01.818025 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:07:01.819842 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53416) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:01.831817 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Received port after_create {{(pid=84112) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:07:01.836530 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:01.840073 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:01.843642 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Pushing event updated for resources: {'Port': ['ID=b3a26ef4-a85c-4cec-a049-f4b7fa8c6375,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:01.870892 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.db.resource_extend [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_utils/timeutils.py:388}} Feb 17 18:07:01.879318 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.340s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:01.896393 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d4d2c3-d6d1-481f-a7aa-6cf8a06d1a1d req-546a7f14-8245-4382-b110-000f73dd4c95 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:01.904996 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-48d4d2c3-d6d1-481f-a7aa-6cf8a06d1a1d req-546a7f14-8245-4382-b110-000f73dd4c95 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 932 time: 0.5818036 Feb 17 18:07:01.993860 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-48d4d2c3-d6d1-481f-a7aa-6cf8a06d1a1d req-21ca598f-fe29-4096-a0d2-e1e5d9d72e32 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0812953 Feb 17 18:07:02.027818 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Notify callbacks [] for port, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:02.147599 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:02.161398 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 7.8946970 Feb 17 18:07:02.192639 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1681264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-399217'] for router_interface, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:02.236111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a {{(pid=84111) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:229}} Feb 17 18:07:02.256529 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Notify callbacks [] for port, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:02.288508 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:02.319036 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Transition to ACTIVE for port object 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a will not be triggered until provisioned by entity L2. {{(pid=84111) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:07:02.333056 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53434) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:02.388601 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:02.445789 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:06:51Z', 'revision_number': 3, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi'}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:02.454431 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:02.461497 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4714ea9-8301-42e0-ac96-ced51348de69 None None] The sync data for ids ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'] in dv-cinder-760194-3-iscsi is: [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:06:51Z', 'revision_number': 3, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi'}] {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:07:02.526327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Request body: {'port': {'device_id': 'b8ff9d7a-1f7b-42c0-b8d1-1f882378df53', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:02.655908 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1376323'] for network, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:02.736478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Notify callbacks [] for port, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:02.815622 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Pushing event updated for resources: {'Port': ['ID=780be217-eb0a-4e51-a67c-6d7f3345b156,revision_number=2']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:02.830508 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.545s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:02.860027 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b6bdae0-f608-4cce-93f7-ab09fbdfb27f admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:02.984038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-8b6bdae0-f608-4cce-93f7-ab09fbdfb27f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:02.988660 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-8b6bdae0-f608-4cce-93f7-ab09fbdfb27f admin admin] Usage tracker for resource:security_group_rule and tenant:fec9498689f548fab319618fe05f3932 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:02.992089 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-8b6bdae0-f608-4cce-93f7-ab09fbdfb27f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:03.005767 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Transition to ACTIVE for port object 3837ab39-c6c1-4f34-9b6b-47c98bdea645 will not be triggered until provisioned by entity DHCP. {{(pid=84112) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:07:03.017790 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-8b6bdae0-f608-4cce-93f7-ab09fbdfb27f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:03.235420 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b6bdae0-f608-4cce-93f7-ab09fbdfb27f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:03.304989 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Pushing event updated for resources: {'Port': ['ID=703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a,revision_number=2']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:03.405583 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.960s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:03.406558 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b6bdae0-f608-4cce-93f7-ab09fbdfb27f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:03.474968 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Network 4aaf4a03-4480-421f-bff4-f9814e969001 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:07:03.500119 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:07:03.511241 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:03.512144 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:03.527513 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:03.537464 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-8b6bdae0-f608-4cce-93f7-ab09fbdfb27f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fec9498689f548fab319618fe05f3932&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2032773 Feb 17 18:07:03.552238 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53452) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:03.562425 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Attempting to bind port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a on host hv-cinder-76019 for vnic_type normal with profile {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:07:03.563208 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Attempting to bind port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a by drivers openvswitch on host hv-cinder-76019 at level 0 using segments [{'id': 'c2d54292-0536-4a70-b118-0e7d52b9d0a7', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '9a6c905d-f0c9-4c01-8dcc-f31837172714'}] {{(pid=84111) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:07:03.563921 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Attempting to bind port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a on network 9a6c905d-f0c9-4c01-8dcc-f31837172714 {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:07:03.615058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Checking agent: {'id': '35b9bf9c-0314-48b9-bb29-ba3a04c8b13c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 18, 4, 47), 'started_at': datetime.datetime(2021, 2, 17, 18, 5, 17), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 6, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.34', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:07:03.615912 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Checking segment: {'id': 'c2d54292-0536-4a70-b118-0e7d52b9d0a7', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '9a6c905d-f0c9-4c01-8dcc-f31837172714'} for mappings: {} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84111) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:07:03.616576 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:03.617197 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Bound using segment: {'id': 'c2d54292-0536-4a70-b118-0e7d52b9d0a7', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '9a6c905d-f0c9-4c01-8dcc-f31837172714'} {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:07:03.617955 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Bound port: 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a, host: hv-cinder-76019, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c2d54292-0536-4a70-b118-0e7d52b9d0a7', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '9a6c905d-f0c9-4c01-8dcc-f31837172714'}}] {{(pid=84111) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:07:03.618605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:03.639557 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-343dba36-9ec4-4823-b8fc-9815642200db req-48c9304f-90cf-4588-a11a-d60ec05d3395 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:03.641606 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-343dba36-9ec4-4823-b8fc-9815642200db req-48c9304f-90cf-4588-a11a-d60ec05d3395 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 943 time: 1.0930684 Feb 17 18:07:03.661940 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b6bdae0-f608-4cce-93f7-ab09fbdfb27f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aff2046f-af43-43e6-a82c-7a00b86be55f,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:03.729666 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-8b6bdae0-f608-4cce-93f7-ab09fbdfb27f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:03.851398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1551647', 'neutron.services.segments.db._delete_segments_for_network-8730056716045'] for network, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:03.920546 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-343dba36-9ec4-4823-b8fc-9815642200db req-f64aff8c-9e6b-4ac8-be2a-38269a4f7897 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2463245 Feb 17 18:07:03.924642 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.023s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:03.944132 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-761938c6-dc9b-4e33-8cff-0e4eaa5090c8 req-db1aece5-54a8-4933-8642-8101ca9a7985 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:03.945011 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-761938c6-dc9b-4e33-8cff-0e4eaa5090c8 req-db1aece5-54a8-4933-8642-8101ca9a7985 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 932 time: 0.6339011 Feb 17 18:07:03.948189 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-aa17760c-f991-4a4b-8554-790357607379 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:04.024479 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-aa17760c-f991-4a4b-8554-790357607379 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:04.121242 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] For port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a, host hv-cinder-76019, cleared binding levels {{(pid=84111) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:07:04.140187 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-aa17760c-f991-4a4b-8554-790357607379 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:04.156211 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-761938c6-dc9b-4e33-8cff-0e4eaa5090c8 req-e51341c2-ff5b-427d-afa8-9fb9c48dd552 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2027063 Feb 17 18:07:04.159987 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:04.187641 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] For port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a,segment=NetworkSegment(c2d54292-0536-4a70-b118-0e7d52b9d0a7),segment_id=c2d54292-0536-4a70-b118-0e7d52b9d0a7)] {{(pid=84111) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:07:04.194473 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa17760c-f991-4a4b-8554-790357607379 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aff2046f-af43-43e6-a82c-7a00b86be55f,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:04.204248 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-aa17760c-f991-4a4b-8554-790357607379 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:04.217577 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-aa17760c-f991-4a4b-8554-790357607379 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:04.217577 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-aa17760c-f991-4a4b-8554-790357607379 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/aff2046f-af43-43e6-a82c-7a00b86be55f HTTP/1.1" status: 204 len: 168 time: 0.6517365 Feb 17 18:07:04.233760 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:04.438717 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d1d815b4-fd73-4bc6-9cc0-babfa4cca25f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:04.496014 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 03f689c4-eeed-4472-ab9d-f14a0929a430 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:04.639477 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning for port 03f689c4-eeed-4472-ab9d-f14a0929a430 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:07:04.651253 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 03f689c4-eeed-4472-ab9d-f14a0929a430 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:04.653455 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:04.861151 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:04.861837 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:04.879507 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] 10.222.0.70 "PUT /v2.0/ports/703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a HTTP/1.1" status: 200 len: 1157 time: 5.9082448 Feb 17 18:07:04.880164 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0acf3623-ba41-4c0a-9078-ebe03ab82af3', 'tag': '703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:04.990479 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:04.999289 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Pushing event updated for resources: {'Port': ['ID=703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a,revision_number=3']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:05.003458 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.564s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:05.041066 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.042070 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.042924 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.043451 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > port after_create 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.043815 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > port after_delete 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.044197 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > port after_update 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.044645 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.045045 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.045435 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.045785 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.052628 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] For port 03f689c4-eeed-4472-ab9d-f14a0929a430, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=03f689c4-eeed-4472-ab9d-f14a0929a430,segment=NetworkSegment(b5e97d06-6722-4de8-9658-658adc74c7b4),segment_id=b5e97d06-6722-4de8-9658-658adc74c7b4)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:07:05.085039 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:05.090936 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-32f83bc3-7229-4446-ac78-e0b8dcff4bd5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:05.227966 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.228363 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.228783 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.229127 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=84112) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:05.229526 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d0113fdf-2728-4712-b5a7-48b6cde96686']}} {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:05.238025 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Pushing event updated for resources: {'Port': ['ID=03f689c4-eeed-4472-ab9d-f14a0929a430,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:05.245425 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e39a606a-42ef-4057-9215-ad4d588cb178') {'for_net_delete': True} {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:05.251001 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e39a606a-42ef-4057-9215-ad4d588cb178') {} {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:05.251275 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:05.258852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8730056711181', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2158030'] for segment, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:05.307911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f702de-decd-47ab-b67f-b3b74429cfb0 req-3ad990c8-e9fc-44e4-b879-aad89c1bea47 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:05.307911 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-93f702de-decd-47ab-b67f-b3b74429cfb0 req-3ad990c8-e9fc-44e4-b879-aad89c1bea47 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 943 time: 0.1526279 Feb 17 18:07:05.352760 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53488) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:05.425552 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0d6cfc0b-3857-4425-9ed3-c0cc3c4f2b34 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:05.452272 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-93f702de-decd-47ab-b67f-b3b74429cfb0 req-b000bea0-8ea3-438a-adc7-2af4b1d17c73 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982409 Feb 17 18:07:05.453404 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-0d6cfc0b-3857-4425-9ed3-c0cc3c4f2b34 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:05.465008 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-0d6cfc0b-3857-4425-9ed3-c0cc3c4f2b34 admin admin] Usage tracker for resource:security_group_rule and tenant:fee06a6cbf9e48bbb1a41aa213c400ae is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:05.469473 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:05.471082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-0d6cfc0b-3857-4425-9ed3-c0cc3c4f2b34 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:05.472299 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Releasing vxlan tunnel 6 to pool {{(pid=84112) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:322}} Feb 17 18:07:05.489400 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-0d6cfc0b-3857-4425-9ed3-c0cc3c4f2b34 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:05.491185 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Pushing event updated for resources: {'Port': ['ID=3837ab39-c6c1-4f34-9b6b-47c98bdea645,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:05.531748 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d4bab9-db3b-4cc0-94a8-22d9e473e3c2 req-f5654e80-dae6-4e44-b4bd-52e46c99d5c5 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:05.533541 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-20d4bab9-db3b-4cc0-94a8-22d9e473e3c2 req-f5654e80-dae6-4e44-b4bd-52e46c99d5c5 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 932 time: 0.2286305 Feb 17 18:07:05.548013 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.624s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:05.636238 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-20d4bab9-db3b-4cc0-94a8-22d9e473e3c2 req-535f2351-578d-4f0a-bfa8-124e6aa57670 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0894239 Feb 17 18:07:05.676050 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:07:05.689347 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:07:05.723824 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Received port after_create {{(pid=84112) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:07:05.724494 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036854376681'] for router_interface, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:05.803223 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0d6cfc0b-3857-4425-9ed3-c0cc3c4f2b34 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:05.839204 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0d6cfc0b-3857-4425-9ed3-c0cc3c4f2b34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:05.873286 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:05.987171 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-0d6cfc0b-3857-4425-9ed3-c0cc3c4f2b34 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fee06a6cbf9e48bbb1a41aa213c400ae&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6290274 Feb 17 18:07:05.987171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d6cfc0b-3857-4425-9ed3-c0cc3c4f2b34 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eecebd67-0fbc-4f16-a5aa-f95da3c807cb,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:05.999776 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53500) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:06.002798 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0d6cfc0b-3857-4425-9ed3-c0cc3c4f2b34 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:06.058926 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0acf3623-ba41-4c0a-9078-ebe03ab82af3', 'tag': '703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a', 'status': 'completed', 'code': 200} Feb 17 18:07:06.079498 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-99101238-5287-4948-a47e-2f336e149a99 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:06.108873 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-99101238-5287-4948-a47e-2f336e149a99 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:06.130416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-17154171-add5-4655-a3d7-dbda742243f7 None None] Provisioning for port 3837ab39-c6c1-4f34-9b6b-47c98bdea645 completed by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:07:06.137745 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-17154171-add5-4655-a3d7-dbda742243f7 None None] Provisioning complete for port 3837ab39-c6c1-4f34-9b6b-47c98bdea645 triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:06.138612 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-17154171-add5-4655-a3d7-dbda742243f7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:06.153964 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Network d0113fdf-2728-4712-b5a7-48b6cde96686 has no segments {{(pid=84112) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:07:06.178881 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1547159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2235342'] for segment, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:06.216321 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-99101238-5287-4948-a47e-2f336e149a99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:06.223709 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0d6cfc0b-3857-4425-9ed3-c0cc3c4f2b34 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:06.235616 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-17154171-add5-4655-a3d7-dbda742243f7 None None] Port 3837ab39-c6c1-4f34-9b6b-47c98bdea645 cannot update to ACTIVE because it is not bound. {{(pid=84113) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:332}} Feb 17 18:07:06.248905 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99101238-5287-4948-a47e-2f336e149a99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eecebd67-0fbc-4f16-a5aa-f95da3c807cb,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:06.257870 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-99101238-5287-4948-a47e-2f336e149a99 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:06.259326 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-99101238-5287-4948-a47e-2f336e149a99 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/eecebd67-0fbc-4f16-a5aa-f95da3c807cb HTTP/1.1" status: 204 len: 168 time: 0.2584729 Feb 17 18:07:06.261203 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-99101238-5287-4948-a47e-2f336e149a99 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:06.333962 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Router 753da3f7-eb03-4d22-b4aa-61cd56b0892f has already been hosted by L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b {{(pid=84112) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:130}} Feb 17 18:07:06.427755 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 03f689c4-eeed-4472-ab9d-f14a0929a430 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:06.530839 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Network d0113fdf-2728-4712-b5a7-48b6cde96686 has no segments {{(pid=84112) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:07:06.534838 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 03f689c4-eeed-4472-ab9d-f14a0929a430 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:06.535340 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: from cryptography.utils import int_from_bytes Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: from cryptography.utils import int_from_bytes Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/relationships.py:1998: SAWarning: Setting backref / back_populates on relationship QosNetworkPolicyBinding.port to refer to viewonly relationship Port.qos_network_policy_binding should include sync_backref=False set on the QosNetworkPolicyBinding.port relationship. (this warning may be suppressed after 10 occurrences) Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: (rel_b, rel_a, rel_b), Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/relationships.py:1998: SAWarning: Setting backref / back_populates on relationship Tag.standard_attr to refer to viewonly relationship StandardAttribute.tags should include sync_backref=False set on the Tag.standard_attr relationship. (this warning may be suppressed after 10 occurrences) Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: (rel_b, rel_a, rel_b), Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: Traceback (most recent call last): Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: timer() Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: cb(*args, **kw) Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/common/utils.py", line 973, in wrapper Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: return func(*args, **kwargs) Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: self._notify() Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: self.callback(batched_events) Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: event.method(event) Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: segment_id)['aggregates'][0] Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: return f(self, *a, **k) Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: return self._get(url).json() Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: **kwargs) Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1131, in get Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: return self.request(url, 'GET', **kwargs) Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 802, in request Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: **endpoint_filter) Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 17 18:07:06.655385 dv-cinder-760194-3-iscsi neutron-server[84000]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 17 18:07:06.819616 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 {{(pid=84112) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:229}} Feb 17 18:07:06.859183 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Notify callbacks [] for port, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:06.946584 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff19b0d4-34f9-4179-87c1-f7a9b3b0bd31 req-6fb2474b-b193-4a62-bee4-7991bdd459b2 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:06.950885 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ff19b0d4-34f9-4179-87c1-f7a9b3b0bd31 req-6fb2474b-b193-4a62-bee4-7991bdd459b2 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 943 time: 0.1772339 Feb 17 18:07:07.064977 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Transition to ACTIVE for port object b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 will not be triggered until provisioned by entity L2. {{(pid=84112) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:07:07.123568 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ff19b0d4-34f9-4179-87c1-f7a9b3b0bd31 req-d5116da4-ff01-441d-99bd-c3b5df1196ef tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0951855 Feb 17 18:07:07.141271 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:07.174082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea9f8fec-530f-49cb-8b64-8912e4d84b04 req-9473877b-f584-4c04-84cf-d35c30e1d82d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:07.175787 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ea9f8fec-530f-49cb-8b64-8912e4d84b04 req-9473877b-f584-4c04-84cf-d35c30e1d82d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 932 time: 0.2227583 Feb 17 18:07:07.179635 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:07.249653 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ea9f8fec-530f-49cb-8b64-8912e4d84b04 req-65746490-2689-4742-839f-47290140bc9e tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0623832 Feb 17 18:07:07.311627 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:07.353071 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853224169', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036854319422'] for network, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:07.415613 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Pushing event updated for resources: {'Port': ['ID=b3a26ef4-a85c-4cec-a049-f4b7fa8c6375,revision_number=2']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:07.450582 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:07.451712 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c92847f9-cc7d-4835-9625-498f9c2e8270 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:07.467151 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84112) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:07:07.493228 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Sync routers for ids ['753da3f7-eb03-4d22-b4aa-61cd56b0892f'] in dv-cinder-760194-3-iscsi {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:07:07.507217 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Routers {'753da3f7-eb03-4d22-b4aa-61cd56b0892f'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:07:07.507940 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:06:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['753da3f7-eb03-4d22-b4aa-61cd56b0892f'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:07.522161 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Pushing event deleted for resources: {'Network': ['ID=d0113fdf-2728-4712-b5a7-48b6cde96686,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:07.525188 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:07.537918 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] 10.222.0.13 "PUT /v2.0/routers/753da3f7-eb03-4d22-b4aa-61cd56b0892f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 16.9971056 Feb 17 18:07:07.592236 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:07.594521 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e2aabe7c-5d63-4e55-a5d5-2604322d1947 admin admin] 10.222.0.13 "DELETE /v2.0/networks/d0113fdf-2728-4712-b5a7-48b6cde96686 HTTP/1.1" status: 204 len: 168 time: 5.7663755 Feb 17 18:07:07.597570 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53558) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:07.708189 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4310d1fc-3161-4d3d-acc1-4ccf2ad9a0ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:07.859523 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_v2 [None req-c4bae428-fc62-4e3c-816e-e409e3adfe5b admin admin] Deleting subnet ea6eb38a-5199-45bc-a83a-e25a2934861b {{(pid=84111) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1041}} Feb 17 18:07:07.882617 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c4bae428-fc62-4e3c-816e-e409e3adfe5b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:07.994754 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Set router 753da3f7-eb03-4d22-b4aa-61cd56b0892f gateway port host: dv-cinder-760194-3-iscsi {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:07:07.998296 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c4bae428-fc62-4e3c-816e-e409e3adfe5b admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:08.018785 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c4bae428-fc62-4e3c-816e-e409e3adfe5b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1550982'] for subnet, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:08.579117 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Notify callbacks [] for port, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:08.581931 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Attempting to bind port b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:07:08.582327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Attempting to bind port b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 by drivers openvswitch on host hv-cinder-76019 at level 0 using segments [{'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:07:08.582696 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Attempting to bind port b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 on network ee1c48e9-8681-4765-bc5b-bc0215d911a4 {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:07:08.590802 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Checking agent: {'id': '35b9bf9c-0314-48b9-bb29-ba3a04c8b13c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 18, 4, 47), 'started_at': datetime.datetime(2021, 2, 17, 18, 5, 17), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 6, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.34', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:07:08.591187 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Checking segment: {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'} for mappings: {} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:07:08.591631 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:08.592066 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Bound using segment: {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:07:08.592584 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Bound port: b3a26ef4-a85c-4cec-a049-f4b7fa8c6375, host: hv-cinder-76019, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'}}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:07:08.592971 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:08.638504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:08.798771 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:08.800315 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2911e758-1a86-49f1-880d-cdeeecc90cdf req-a998d431-3ccc-4c62-a517-8e9c63d60901 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:08.802378 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2911e758-1a86-49f1-880d-cdeeecc90cdf req-a998d431-3ccc-4c62-a517-8e9c63d60901 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 943 time: 0.3156300 Feb 17 18:07:08.841812 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1681264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-399217'] for router_interface, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:08.956294 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'name': 'tempest-ServerRescueNegativeTestJSON-1294029612-router', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160'}], 'enable_snat': True}, 'gw_port_id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:43Z', 'updated_at': '2021-02-17T18:06:59Z', 'revision_number': 4, 'project_id': 'bda7a35e855840d7bc75e16e402f3690', 'gw_port': {'id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:8a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:46Z', 'updated_at': '2021-02-17T18:06:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': '780be217-eb0a-4e51-a67c-6d7f3345b156', 'name': '', 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'mac_address': 'fa:16:3e:b2:88:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'device_owner': 'network:router_interface', 'standard_attr_id': 112, 'fixed_ips': [{'subnet_id': 'c04f01da-1295-4b8a-95ae-46589cb07040', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:54Z', 'updated_at': '2021-02-17T18:07:00Z', 'revision_number': 2, 'project_id': 'bda7a35e855840d7bc75e16e402f3690', 'subnets': [{'id': 'c04f01da-1295-4b8a-95ae-46589cb07040', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:08.965563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Checking router: 753da3f7-eb03-4d22-b4aa-61cd56b0892f for host: dv-cinder-760194-3-iscsi {{(pid=84114) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:07:08.966649 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Updating router 753da3f7-eb03-4d22-b4aa-61cd56b0892f port 780be217-eb0a-4e51-a67c-6d7f3345b156 binding host dv-cinder-760194-3-iscsi {{(pid=84114) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:208}} Feb 17 18:07:09.079709 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:09.116571 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Pushing event updated for resources: {'Port': ['ID=3837ab39-c6c1-4f34-9b6b-47c98bdea645,revision_number=2']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:09.138848 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.340s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:09.175209 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] For port b3a26ef4-a85c-4cec-a049-f4b7fa8c6375, host hv-cinder-76019, cleared binding levels {{(pid=84112) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:07:09.209930 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] For port b3a26ef4-a85c-4cec-a049-f4b7fa8c6375, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=b3a26ef4-a85c-4cec-a049-f4b7fa8c6375,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84112) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:07:09.242425 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:07:09.243615 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:07:09.336640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:09.545181 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-376a4419-3ac6-4241-93b5-43b6e48c8d0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:09.613114 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-4c7cdec3-0c0b-461b-97b1-976fbf20834f None None] Provisioning complete for port 3837ab39-c6c1-4f34-9b6b-47c98bdea645 triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:09.613529 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4c7cdec3-0c0b-461b-97b1-976fbf20834f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:09.618278 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2911e758-1a86-49f1-880d-cdeeecc90cdf req-21ea231a-6774-4e1c-a379-e64d25a167d1 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3996534 Feb 17 18:07:09.688642 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c4bae428-fc62-4e3c-816e-e409e3adfe5b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853224802', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for subnet, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:09.714820 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-b7801ba8-dc11-4e04-a7a0-40de8fd9b103 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:09.715678 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-b7801ba8-dc11-4e04-a7a0-40de8fd9b103 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Synchronizing usage tracker for tenant:bda7a35e855840d7bc75e16e402f3690 on resource:network {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:07:09.757224 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Pushing event updated for resources: {'Port': ['ID=b3a26ef4-a85c-4cec-a049-f4b7fa8c6375,revision_number=3']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:09.770668 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:09.900784 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 has already been hosted by L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b {{(pid=84112) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:130}} Feb 17 18:07:09.921746 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53642) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:09.938238 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-4c7cdec3-0c0b-461b-97b1-976fbf20834f None None] Port 3837ab39-c6c1-4f34-9b6b-47c98bdea645 cannot update to ACTIVE because it is not bound. {{(pid=84113) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:332}} Feb 17 18:07:09.954550 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:09.976299 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-72babbee-55e8-4ec7-87a5-69d288cbc68b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:10.007897 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Notify callbacks [] for port, precommit_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:10.021540 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Transition to ACTIVE for port object 780be217-eb0a-4e51-a67c-6d7f3345b156 will not be triggered until provisioned by entity L2. {{(pid=84114) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:07:10.050836 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:10.072469 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-57b1d09a-cfba-4ec3-9aad-a2dc548bd633 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:10.099720 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-b7801ba8-dc11-4e04-a7a0-40de8fd9b103 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Unset dirty status for tenant:bda7a35e855840d7bc75e16e402f3690 on resource:network {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:07:10.101068 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-b7801ba8-dc11-4e04-a7a0-40de8fd9b103 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 819 time: 0.8453231 Feb 17 18:07:10.101741 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4bae428-fc62-4e3c-816e-e409e3adfe5b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ea6eb38a-5199-45bc-a83a-e25a2934861b,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:10.128314 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c4bae428-fc62-4e3c-816e-e409e3adfe5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:10.133370 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:10.134062 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:10.135737 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] 10.222.0.70 "PUT /v2.0/ports/b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 HTTP/1.1" status: 200 len: 1158 time: 7.8880227 Feb 17 18:07:10.136255 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b8ff9d7a-1f7b-42c0-b8d1-1f882378df53', 'tag': 'b3a26ef4-a85c-4cec-a049-f4b7fa8c6375'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:10.163043 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c4bae428-fc62-4e3c-816e-e409e3adfe5b admin admin] Notify callbacks [] for subnet, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:10.171555 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c4bae428-fc62-4e3c-816e-e409e3adfe5b admin admin] 10.222.0.13 "DELETE /v2.0/subnets/ea6eb38a-5199-45bc-a83a-e25a2934861b HTTP/1.1" status: 204 len: 168 time: 2.5725944 Feb 17 18:07:10.172337 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84112) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:07:10.175656 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-1ea58ac2-340f-4a01-9103-ff46d2db3386 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:10.176667 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53652) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:10.177849 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-1ea58ac2-340f-4a01-9103-ff46d2db3386 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=ea1a0242f4cf40fd9bd267013f65af40&device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 1160 time: 0.9209003 Feb 17 18:07:10.179488 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-9c469ec1-d28a-43a4-a120-821c8f6dc575 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/quotas/bda7a35e855840d7bc75e16e402f3690 HTTP/1.1" status: 200 len: 375 time: 0.0571146 Feb 17 18:07:10.180977 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] 10.222.0.13 "PUT /v2.0/routers/26ce0b68-6f29-498d-8e7d-e9fdae0ac663/add_router_interface HTTP/1.1" status: 200 len: 503 time: 14.4698255 Feb 17 18:07:10.195625 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Sync routers for ids ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'] in dv-cinder-760194-3-iscsi {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:07:10.226724 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Routers {'26ce0b68-6f29-498d-8e7d-e9fdae0ac663'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:07:10.227537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:07:10Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:10.304122 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44e460c8-90cf-47d4-ba7a-ad1cc5879a59 None None] Pushing event updated for resources: {'Port': ['ID=780be217-eb0a-4e51-a67c-6d7f3345b156,revision_number=3']} {{(pid=84114) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:10.322068 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-44e460c8-90cf-47d4-ba7a-ad1cc5879a59 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:10.480149 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9881b7b0-cd7f-46bb-8468-274285ebd2ec req-f3a1a1c7-93b5-4b51-a94a-b19682c04f19 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:10.488818 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9881b7b0-cd7f-46bb-8468-274285ebd2ec req-f3a1a1c7-93b5-4b51-a94a-b19682c04f19 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 944 time: 0.5355778 Feb 17 18:07:10.515166 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-2d26c9ad-08c7-42ef-b8df-8b641e1c19ff service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a HTTP/1.1" status: 200 len: 217 time: 0.2982445 Feb 17 18:07:10.535604 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Attempting to bind port 780be217-eb0a-4e51-a67c-6d7f3345b156 on host dv-cinder-760194-3-iscsi for vnic_type normal with profile {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:07:10.535942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Attempting to bind port 780be217-eb0a-4e51-a67c-6d7f3345b156 by drivers openvswitch on host dv-cinder-760194-3-iscsi at level 0 using segments [{'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'}] {{(pid=84114) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:07:10.536339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Attempting to bind port 780be217-eb0a-4e51-a67c-6d7f3345b156 on network 4aaf4a03-4480-421f-bff4-f9814e969001 {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:07:10.544230 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Checking agent: {'id': '3fdd9543-fb8c-4d73-992e-15dd132fbdf2', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760194-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'started_at': datetime.datetime(2021, 2, 17, 17, 58, 12), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 6, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760194-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.58', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:07:10.544644 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Checking segment: {'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84114) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:07:10.545086 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:10.545517 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Bound using segment: {'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'} {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:07:10.546027 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Bound port: 780be217-eb0a-4e51-a67c-6d7f3345b156, host: dv-cinder-760194-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'}}] {{(pid=84114) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:07:10.546441 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:10.604265 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Set router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:07:10.609116 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-5aec1d72-7d53-49f2-a2c3-970f3686ffbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:10.611084 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-5aec1d72-7d53-49f2-a2c3-970f3686ffbe service neutron] 10.222.0.70 "GET /v2.0/subnets?id=a5b0cdf5-0893-43d1-8023-c370f1f6ab8c HTTP/1.1" status: 200 len: 852 time: 0.0760796 Feb 17 18:07:10.634136 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9881b7b0-cd7f-46bb-8468-274285ebd2ec req-ae2924c2-97de-49bc-b384-653b7b6410f9 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1440113 Feb 17 18:07:10.710421 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] For port 780be217-eb0a-4e51-a67c-6d7f3345b156, host dv-cinder-760194-3-iscsi, cleared binding levels {{(pid=84114) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:07:10.716639 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9180cd68-64cb-4901-a252-b0fa4ae558e3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:10.721600 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] For port 780be217-eb0a-4e51-a67c-6d7f3345b156, host dv-cinder-760194-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=780be217-eb0a-4e51-a67c-6d7f3345b156,segment=NetworkSegment(eaf585ce-3bb4-4c27-942c-8aa396958840),segment_id=eaf585ce-3bb4-4c27-942c-8aa396958840)] {{(pid=84114) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:07:10.772138 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:10.776433 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-9180cd68-64cb-4901-a252-b0fa4ae558e3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:10.780767 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-9180cd68-64cb-4901-a252-b0fa4ae558e3 admin admin] Usage tracker for resource:security_group_rule and tenant:542f1c8e0bdb4cb4977815f6c27b68ae is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:10.783958 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-9180cd68-64cb-4901-a252-b0fa4ae558e3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:10.784817 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-c462cf02-703a-4e03-85fa-ee9d463be7c1 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=9a6c905d-f0c9-4c01-8dcc-f31837172714&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1486585 Feb 17 18:07:10.789946 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-9180cd68-64cb-4901-a252-b0fa4ae558e3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:10.809909 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:10.886271 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9180cd68-64cb-4901-a252-b0fa4ae558e3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:10.902004 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1376323'] for network, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:11.006092 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-9967fec2-630b-48f2-b18d-ad574a54c4d2 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&fields=id HTTP/1.1" status: 200 len: 255 time: 0.7901993 Feb 17 18:07:11.039923 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9180cd68-64cb-4901-a252-b0fa4ae558e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:11.060085 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:11.078399 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-65077fc5-7acc-461e-b8cf-a77012162e1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:11.080116 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-65077fc5-7acc-461e-b8cf-a77012162e1c service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 1161 time: 0.8220081 Feb 17 18:07:11.098585 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:07:06Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': '3837ab39-c6c1-4f34-9b6b-47c98bdea645', 'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'mac_address': 'fa:16:3e:7a:00:7b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_interface', 'standard_attr_id': 120, 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:07:00Z', 'updated_at': '2021-02-17T18:07:07Z', 'revision_number': 2, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'subnets': [{'id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:11.103071 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Checking router: 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 for host: dv-cinder-760194-3-iscsi {{(pid=84113) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:07:11.104600 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Updating router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 port 3837ab39-c6c1-4f34-9b6b-47c98bdea645 binding host dv-cinder-760194-3-iscsi {{(pid=84113) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:208}} Feb 17 18:07:11.156244 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:11.185066 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-9180cd68-64cb-4901-a252-b0fa4ae558e3 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=542f1c8e0bdb4cb4977815f6c27b68ae&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2589729 Feb 17 18:07:11.185256 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:11.211128 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53686) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:11.222431 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44e460c8-90cf-47d4-ba7a-ad1cc5879a59 None None] Pushing event updated for resources: {'Port': ['ID=780be217-eb0a-4e51-a67c-6d7f3345b156,revision_number=4']} {{(pid=84114) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:11.244108 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-44e460c8-90cf-47d4-ba7a-ad1cc5879a59 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.434s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:11.319783 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-3c49b394-2e32-4e93-8865-8c594b125085 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 HTTP/1.1" status: 200 len: 217 time: 0.1640580 Feb 17 18:07:11.357666 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Routers {'753da3f7-eb03-4d22-b4aa-61cd56b0892f'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:07:11.358352 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:07:10Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['753da3f7-eb03-4d22-b4aa-61cd56b0892f'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:11.397316 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-54c1cc31-2dc8-4c1a-bb2a-a9ec9e2aa48e service neutron] 10.222.0.70 "GET /v2.0/networks/9a6c905d-f0c9-4c01-8dcc-f31837172714?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6115205 Feb 17 18:07:11.454975 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9ec65038-058a-4649-af29-6e971835e32e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:11.521874 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-f6852a07-2c17-49df-8742-88c48b9878ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:11.528270 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-f6852a07-2c17-49df-8742-88c48b9878ac service neutron] 10.222.0.70 "GET /v2.0/subnets?id=e1b65f5a-677d-4368-874f-50623d3454b9 HTTP/1.1" status: 200 len: 855 time: 0.1642551 Feb 17 18:07:11.640438 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fd1edab6-003c-4510-b312-ee31b488f432 service neutron] 10.222.0.13 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6330667 Feb 17 18:07:11.652526 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53698) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:11.710376 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] Set router 753da3f7-eb03-4d22-b4aa-61cd56b0892f gateway port host: dv-cinder-760194-3-iscsi {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:07:11.717131 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-ee7c6fcb-afef-4952-8175-3f47a8c2869e service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=ee1c48e9-8681-4765-bc5b-bc0215d911a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1734562 Feb 17 18:07:11.758997 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9180cd68-64cb-4901-a252-b0fa4ae558e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b18ae48d-149f-452e-b672-88fd091f4cc2,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:11.896920 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-6e6f63bc-3fc7-473d-967f-207211b28db8 service neutron] 10.222.0.13 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2553124 Feb 17 18:07:11.911696 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Request body: {'security_group': {'name': 'tempest-securitygroup--669436532', 'description': 'tempest-description--497224663'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:11.944415 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1551647', 'neutron.services.segments.db._delete_segments_for_network-8730056716045'] for network, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:11.985481 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:11.999741 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Usage tracker for resource:security_group and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:12.003804 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9ec65038-058a-4649-af29-6e971835e32e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:12.018354 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:12.042895 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:12.051991 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:12.113047 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Notify callbacks [] for port, precommit_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:12.147243 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Transition to ACTIVE for port object 3837ab39-c6c1-4f34-9b6b-47c98bdea645 will not be triggered until provisioned by entity L2. {{(pid=84113) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:07:12.149062 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b8ff9d7a-1f7b-42c0-b8d1-1f882378df53', 'tag': 'b3a26ef4-a85c-4cec-a049-f4b7fa8c6375', 'status': 'completed', 'code': 200} Feb 17 18:07:12.149183 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:12.162533 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9180cd68-64cb-4901-a252-b0fa4ae558e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.005s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:12.162627 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'name': 'tempest-ServerRescueNegativeTestJSON-1294029612-router', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160'}], 'enable_snat': True}, 'gw_port_id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:43Z', 'updated_at': '2021-02-17T18:06:59Z', 'revision_number': 4, 'project_id': 'bda7a35e855840d7bc75e16e402f3690', 'gw_port': {'id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:8a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:46Z', 'updated_at': '2021-02-17T18:06:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': '780be217-eb0a-4e51-a67c-6d7f3345b156', 'name': '', 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'mac_address': 'fa:16:3e:b2:88:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'device_owner': 'network:router_interface', 'standard_attr_id': 112, 'fixed_ips': [{'subnet_id': 'c04f01da-1295-4b8a-95ae-46589cb07040', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:54Z', 'updated_at': '2021-02-17T18:07:10Z', 'revision_number': 4, 'project_id': 'bda7a35e855840d7bc75e16e402f3690', 'subnets': [{'id': 'c04f01da-1295-4b8a-95ae-46589cb07040', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:12.165708 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497ebce8-288d-4aa4-9f3e-660e4a3bc812 req-b0b9bc37-fed6-4036-9934-6673cfbd33bd service neutron] 10.222.0.70 "GET /v2.0/networks/9a6c905d-f0c9-4c01-8dcc-f31837172714?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.7180476 Feb 17 18:07:12.182763 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:12.182959 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d035fa85-8e2d-44be-92ff-c3fb6a2efeb2 None None] The sync data for ids ['753da3f7-eb03-4d22-b4aa-61cd56b0892f'] in dv-cinder-760194-3-iscsi is: [{'id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'name': 'tempest-ServerRescueNegativeTestJSON-1294029612-router', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160'}], 'enable_snat': True}, 'gw_port_id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:43Z', 'updated_at': '2021-02-17T18:06:59Z', 'revision_number': 4, 'project_id': 'bda7a35e855840d7bc75e16e402f3690', 'gw_port': {'id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:8a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:46Z', 'updated_at': '2021-02-17T18:06:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': '780be217-eb0a-4e51-a67c-6d7f3345b156', 'name': '', 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'mac_address': 'fa:16:3e:b2:88:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'device_owner': 'network:router_interface', 'standard_attr_id': 112, 'fixed_ips': [{'subnet_id': 'c04f01da-1295-4b8a-95ae-46589cb07040', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:54Z', 'updated_at': '2021-02-17T18:07:10Z', 'revision_number': 4, 'project_id': 'bda7a35e855840d7bc75e16e402f3690', 'subnets': [{'id': 'c04f01da-1295-4b8a-95ae-46589cb07040', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}] {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:07:12.197048 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8d603a1-dc93-4efa-af94-7988f9109481 req-656fa360-6b20-4aec-b2fa-e016fe59040c tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:12.210004 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f8d603a1-dc93-4efa-af94-7988f9109481 req-656fa360-6b20-4aec-b2fa-e016fe59040c tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 943 time: 0.2703404 Feb 17 18:07:12.267739 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:12.278288 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9ec65038-058a-4649-af29-6e971835e32e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:12.284124 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Usage tracker for resource:security_group_rule and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:12.297571 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:12.357753 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-23b893ca-ee8a-4abc-a74e-22ea57212c23 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:12.407368 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ec65038-058a-4649-af29-6e971835e32e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b18ae48d-149f-452e-b672-88fd091f4cc2,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:12.410553 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9ec65038-058a-4649-af29-6e971835e32e admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:12.414162 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-9ec65038-058a-4649-af29-6e971835e32e admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b18ae48d-149f-452e-b672-88fd091f4cc2 HTTP/1.1" status: 204 len: 168 time: 1.1996162 Feb 17 18:07:12.417865 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f8d603a1-dc93-4efa-af94-7988f9109481 req-a3ce123f-c388-4e77-b2e8-11c1084e6313 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2068572 Feb 17 18:07:12.418911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:12.423397 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9ec65038-058a-4649-af29-6e971835e32e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:12.470708 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:12.540753 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 780be217-eb0a-4e51-a67c-6d7f3345b156 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:12.577305 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['18109d6a-747c-4258-bd9e-533efa016ff4']}} {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:12.609106 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-2b6e5ddf-d531-4c8f-9cb7-426a29aef491 service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8409925 Feb 17 18:07:12.848602 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c63ea37-b974-4ebe-9488-af3a174517f7 None None] Pushing event updated for resources: {'Port': ['ID=3837ab39-c6c1-4f34-9b6b-47c98bdea645,revision_number=3']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:12.856567 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9c63ea37-b974-4ebe-9488-af3a174517f7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.386s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:12.965541 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-22074909-3c4c-4a73-8d05-a09f538d2ee3 req-342a281a-2b28-4d45-a42a-b4ce247d1a75 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 210 time: 0.2139044 Feb 17 18:07:13.015757 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning for port 780be217-eb0a-4e51-a67c-6d7f3345b156 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:07:13.036860 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 780be217-eb0a-4e51-a67c-6d7f3345b156 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:13.037492 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:13.114489 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:13.234547 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:13.248765 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Attempting to bind port 3837ab39-c6c1-4f34-9b6b-47c98bdea645 on host dv-cinder-760194-3-iscsi for vnic_type normal with profile {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:07:13.248765 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Attempting to bind port 3837ab39-c6c1-4f34-9b6b-47c98bdea645 by drivers openvswitch on host dv-cinder-760194-3-iscsi at level 0 using segments [{'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:07:13.248765 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Attempting to bind port 3837ab39-c6c1-4f34-9b6b-47c98bdea645 on network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:07:13.279814 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Checking agent: {'id': '3fdd9543-fb8c-4d73-992e-15dd132fbdf2', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760194-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'started_at': datetime.datetime(2021, 2, 17, 17, 58, 12), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 7, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760194-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.58', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:07:13.281595 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:13.282536 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Checking segment: {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84113) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:07:13.283459 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:13.284085 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Bound using segment: {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:07:13.284770 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Bound port: 3837ab39-c6c1-4f34-9b6b-47c98bdea645, host: dv-cinder-760194-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'}}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:07:13.285333 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:13.308972 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:13.336251 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02271d28-2f5b-4b76-a11f-c33a829aca44 req-40252e24-4b58-4ce2-8386-b177c35a38f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:13.337817 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-02271d28-2f5b-4b76-a11f-c33a829aca44 req-40252e24-4b58-4ce2-8386-b177c35a38f5 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=ea1a0242f4cf40fd9bd267013f65af40&device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 1160 time: 1.0371923 Feb 17 18:07:13.406060 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd1933c99-d69f-40e4-a095-182836e6ad6b') {'for_net_delete': True} {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:13.406422 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd1933c99-d69f-40e4-a095-182836e6ad6b') {} {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:13.479084 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8730056711181', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2158030'] for segment, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:13.500456 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] For port 3837ab39-c6c1-4f34-9b6b-47c98bdea645, host dv-cinder-760194-3-iscsi, cleared binding levels {{(pid=84113) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:07:13.504305 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53748) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:13.505862 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] For port 3837ab39-c6c1-4f34-9b6b-47c98bdea645, host dv-cinder-760194-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=3837ab39-c6c1-4f34-9b6b-47c98bdea645,segment=NetworkSegment(a3b9a246-e8d6-47cc-bbb0-e0531b20a903),segment_id=a3b9a246-e8d6-47cc-bbb0-e0531b20a903)] {{(pid=84113) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:07:13.585279 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:13.823593 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0d39d398-67ca-4b61-8261-c3e603304e42 req-fac7e171-0994-43fb-8ce8-98936cf81a0b service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 1.0589433 Feb 17 18:07:13.823593 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9d978a71-3ae4-4635-96ab-f6eab94e24f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:13.823593 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-9d978a71-3ae4-4635-96ab-f6eab94e24f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:13.823593 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-9d978a71-3ae4-4635-96ab-f6eab94e24f4 admin admin] Usage tracker for resource:security_group_rule and tenant:0f3611c5640e4e799d3e30b46f150819 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:13.824859 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:13.824970 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-9d978a71-3ae4-4635-96ab-f6eab94e24f4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:13.824970 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-9d978a71-3ae4-4635-96ab-f6eab94e24f4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:13.825160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe46d164-8c9c-4053-be4b-a08a82e7e4ca req-4db2e5e8-10ff-4e53-adc1-b6352600e52a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:13.825160 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fe46d164-8c9c-4053-be4b-a08a82e7e4ca req-4db2e5e8-10ff-4e53-adc1-b6352600e52a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 944 time: 1.3395920 Feb 17 18:07:13.825160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9fb6e7b2-439a-4b38-9765-cc107a9dfd37,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:13.825160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.471s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:13.848513 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fe46d164-8c9c-4053-be4b-a08a82e7e4ca req-5c89634a-95ec-4220-bd07-7fa97ce5667b tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0984254 Feb 17 18:07:13.876039 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:13.876039 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1778 time: 1.9913294 Feb 17 18:07:13.876320 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53762) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:13.879524 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-4f22ba9a-e26f-4af3-b209-b01682732a9e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Request body: {'security_group_rule': {'security_group_id': '9fb6e7b2-439a-4b38-9765-cc107a9dfd37', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:13.912929 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:13.920582 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] Releasing vxlan tunnel 8 to pool {{(pid=84112) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:322}} Feb 17 18:07:13.955017 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-8571ef37-bd48-4a02-9c5a-f1b3cec60b7a tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:13.957094 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-8571ef37-bd48-4a02-9c5a-f1b3cec60b7a tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 819 time: 0.3363593 Feb 17 18:07:13.961919 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02271d28-2f5b-4b76-a11f-c33a829aca44 req-94010a1a-7a2a-409b-8616-5949a61c0b70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:13.964036 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-02271d28-2f5b-4b76-a11f-c33a829aca44 req-94010a1a-7a2a-409b-8616-5949a61c0b70 service neutron] 10.222.0.70 "GET /v2.0/networks?id=9a6c905d-f0c9-4c01-8dcc-f31837172714 HTTP/1.1" status: 200 len: 906 time: 0.6147192 Feb 17 18:07:14.057581 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:14.157458 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c63ea37-b974-4ebe-9488-af3a174517f7 None None] Pushing event updated for resources: {'Port': ['ID=3837ab39-c6c1-4f34-9b6b-47c98bdea645,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:14.182788 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9c63ea37-b974-4ebe-9488-af3a174517f7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.479s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:14.186181 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53768) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:14.197765 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] Network 18109d6a-747c-4258-bd9e-533efa016ff4 has no segments {{(pid=84112) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:07:14.209158 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1547159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2235342'] for segment, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:14.227297 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-02271d28-2f5b-4b76-a11f-c33a829aca44 req-381cf1a7-f3d1-46e1-9a48-8c59e9da252c service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a HTTP/1.1" status: 200 len: 217 time: 0.2522886 Feb 17 18:07:14.228757 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-cd344faa-52dc-4f0c-be3d-a094bb6a04b8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/quotas/bda7a35e855840d7bc75e16e402f3690 HTTP/1.1" status: 200 len: 375 time: 0.2627261 Feb 17 18:07:14.248614 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] For port 780be217-eb0a-4e51-a67c-6d7f3345b156, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=780be217-eb0a-4e51-a67c-6d7f3345b156,segment=NetworkSegment(eaf585ce-3bb4-4c27-942c-8aa396958840),segment_id=eaf585ce-3bb4-4c27-942c-8aa396958840)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:07:14.264394 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Routers {'26ce0b68-6f29-498d-8e7d-e9fdae0ac663'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:07:14.272736 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:07:10Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:14.414358 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:14.440722 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9d978a71-3ae4-4635-96ab-f6eab94e24f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:14.487039 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-4f22ba9a-e26f-4af3-b209-b01682732a9e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:14.506043 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9d978a71-3ae4-4635-96ab-f6eab94e24f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:14.510002 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-4f22ba9a-e26f-4af3-b209-b01682732a9e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Usage tracker for resource:security_group_rule and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:14.512500 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02271d28-2f5b-4b76-a11f-c33a829aca44 req-309c76fe-7318-47aa-94ca-abe0d1684d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:14.517912 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:14.518177 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-02271d28-2f5b-4b76-a11f-c33a829aca44 req-309c76fe-7318-47aa-94ca-abe0d1684d9b service neutron] 10.222.0.70 "GET /v2.0/subnets?id=a5b0cdf5-0893-43d1-8023-c370f1f6ab8c HTTP/1.1" status: 200 len: 852 time: 0.2522140 Feb 17 18:07:14.532850 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ede3d76a-164d-4e7e-b5a1-55336c92a0b1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:14.548241 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-4f22ba9a-e26f-4af3-b209-b01682732a9e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:14.551845 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:14.589624 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-4f22ba9a-e26f-4af3-b209-b01682732a9e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:14.626619 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-ede3d76a-164d-4e7e-b5a1-55336c92a0b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:14.632079 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-02271d28-2f5b-4b76-a11f-c33a829aca44 req-cbba49fe-eb01-4f87-8d12-e6ad3515619f service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=9a6c905d-f0c9-4c01-8dcc-f31837172714&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0790999 Feb 17 18:07:14.638605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-ede3d76a-164d-4e7e-b5a1-55336c92a0b1 admin admin] Usage tracker for resource:security_group_rule and tenant:f35180a462894998a7e87bd53145d440 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:14.639692 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Pushing event updated for resources: {'Port': ['ID=780be217-eb0a-4e51-a67c-6d7f3345b156,revision_number=5']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:14.644769 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:14.649845 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-ede3d76a-164d-4e7e-b5a1-55336c92a0b1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:14.658722 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] Set router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:07:14.687991 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c128462f-0b27-4a79-b807-c7e0632fdfc1 req-2ce4fcba-5b9a-4f48-8bba-57858f92842b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:14.689601 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c128462f-0b27-4a79-b807-c7e0632fdfc1 req-2ce4fcba-5b9a-4f48-8bba-57858f92842b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 943 time: 0.5907314 Feb 17 18:07:14.690542 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-ede3d76a-164d-4e7e-b5a1-55336c92a0b1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:14.766202 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] Network 18109d6a-747c-4258-bd9e-533efa016ff4 has no segments {{(pid=84112) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:07:14.778155 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4f22ba9a-e26f-4af3-b209-b01682732a9e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group_rule, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: Traceback (most recent call last): Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: timer() Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: cb(*args, **kw) Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/common/utils.py", line 973, in wrapper Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: return func(*args, **kwargs) Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: self._notify() Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: self.callback(batched_events) Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: event.method(event) Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: segment_id)['aggregates'][0] Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: return f(self, *a, **k) Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: return self._get(url).json() Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: **kwargs) Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1131, in get Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: return self.request(url, 'GET', **kwargs) Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 802, in request Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: **endpoint_filter) Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 17 18:07:14.803313 dv-cinder-760194-3-iscsi neutron-server[84000]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 17 18:07:14.807288 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-9d978a71-3ae4-4635-96ab-f6eab94e24f4 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0f3611c5640e4e799d3e30b46f150819&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2863193 Feb 17 18:07:14.817763 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-f28b6f34-7ad5-405f-98dd-31f0f0eadeac tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&fields=id HTTP/1.1" status: 200 len: 255 time: 0.5546386 Feb 17 18:07:14.834632 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53778) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:14.861914 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d978a71-3ae4-4635-96ab-f6eab94e24f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a0f670d-2661-4bd4-ad3f-aa3224fdc93d,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:14.874372 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9d978a71-3ae4-4635-96ab-f6eab94e24f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.323s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:14.921769 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf0f7fb4-38e5-4f80-8035-9fad299398d1 req-988d02b9-9e77-4062-85f4-480cee798f48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:14.923677 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf0f7fb4-38e5-4f80-8035-9fad299398d1 req-988d02b9-9e77-4062-85f4-480cee798f48 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 1161 time: 0.6894431 Feb 17 18:07:14.948377 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c128462f-0b27-4a79-b807-c7e0632fdfc1 req-122a5e26-12db-4fc0-ae66-2df253da087c tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2031822 Feb 17 18:07:15.030185 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-ba786d6d-1981-40ea-b3ae-2cc44d544dbe service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=84111) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 17 18:07:15.035441 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-ba786d6d-1981-40ea-b3ae-2cc44d544dbe service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13455 time: 0.1270080 Feb 17 18:07:15.079429 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:07:06Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': '3837ab39-c6c1-4f34-9b6b-47c98bdea645', 'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'mac_address': 'fa:16:3e:7a:00:7b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_interface', 'standard_attr_id': 120, 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:07:00Z', 'updated_at': '2021-02-17T18:07:13Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'subnets': [{'id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:15.147320 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf0f7fb4-38e5-4f80-8035-9fad299398d1 req-7eec591b-35d8-47e2-aa9b-0358c155d242 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:15.148482 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-566cab83-0800-43a5-bece-2bee6f274b57 None None] The sync data for ids ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'] in dv-cinder-760194-3-iscsi is: [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:07:06Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': '3837ab39-c6c1-4f34-9b6b-47c98bdea645', 'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'mac_address': 'fa:16:3e:7a:00:7b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_interface', 'standard_attr_id': 120, 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:07:00Z', 'updated_at': '2021-02-17T18:07:13Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'subnets': [{'id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}] {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:07:15.149617 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf0f7fb4-38e5-4f80-8035-9fad299398d1 req-7eec591b-35d8-47e2-aa9b-0358c155d242 service neutron] 10.222.0.70 "GET /v2.0/networks?id=ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 200 len: 909 time: 0.2118766 Feb 17 18:07:15.151402 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-02271d28-2f5b-4b76-a11f-c33a829aca44 req-18457cac-c912-4491-ba78-5a73031adeac service neutron] 10.222.0.70 "GET /v2.0/networks/9a6c905d-f0c9-4c01-8dcc-f31837172714?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5048270 Feb 17 18:07:15.160921 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-adc0f75f-863d-4835-ab88-53e17782ec08 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:15.273639 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4f22ba9a-e26f-4af3-b209-b01682732a9e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:15.285099 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf0f7fb4-38e5-4f80-8035-9fad299398d1 req-7dfa4a22-c327-482a-a991-f660754591b1 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 HTTP/1.1" status: 200 len: 217 time: 0.1196287 Feb 17 18:07:15.403316 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf0f7fb4-38e5-4f80-8035-9fad299398d1 req-b656eb41-9038-4dcc-af66-fc1c628f3b0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:15.405546 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf0f7fb4-38e5-4f80-8035-9fad299398d1 req-b656eb41-9038-4dcc-af66-fc1c628f3b0c service neutron] 10.222.0.70 "GET /v2.0/subnets?id=e1b65f5a-677d-4368-874f-50623d3454b9 HTTP/1.1" status: 200 len: 855 time: 0.1131716 Feb 17 18:07:15.448093 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-adc0f75f-863d-4835-ab88-53e17782ec08 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:15.474949 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.objects.ports [None req-0c9656e7-1427-4497-9a38-b058c2e9dff6 None None] Time-cost: Fetching 2 ports in 2 security groups {{(pid=84113) get_objects /opt/stack/neutron/neutron/objects/ports.py:431}} Feb 17 18:07:15.478108 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ede3d76a-164d-4e7e-b5a1-55336c92a0b1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:15.490417 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf0f7fb4-38e5-4f80-8035-9fad299398d1 req-70f3c09b-011b-4f4f-b9a2-fe573e1a018a service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=ee1c48e9-8681-4765-bc5b-bc0215d911a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0775580 Feb 17 18:07:15.631749 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18040656-7325-4b3e-a8f4-bf29f006c6fd req-cf7c5cf8-fa9f-4d95-a8ad-908345986539 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:15.633968 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-18040656-7325-4b3e-a8f4-bf29f006c6fd req-cf7c5cf8-fa9f-4d95-a8ad-908345986539 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 944 time: 0.3340938 Feb 17 18:07:15.643219 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-02271d28-2f5b-4b76-a11f-c33a829aca44 req-d500138a-3ad5-475c-9c93-79002b00af6a service neutron] 10.222.0.70 "GET /v2.0/networks/9a6c905d-f0c9-4c01-8dcc-f31837172714?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.4696484 Feb 17 18:07:15.676469 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-d07fa03c-7638-4715-ac79-bcb821ca42f5 service neutron] 10.222.0.13 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6285679 Feb 17 18:07:15.725920 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf0f7fb4-38e5-4f80-8035-9fad299398d1 req-331c5ef3-2cb8-4217-b02e-3a74425e6351 service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2280819 Feb 17 18:07:15.822668 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-18040656-7325-4b3e-a8f4-bf29f006c6fd req-47e71e23-b092-4ec8-bf1e-d008f7b84f32 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1772063 Feb 17 18:07:15.900855 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-bb23c2f6-074d-4e25-a66e-a0a2dc1f3d45 service neutron] 10.222.0.13 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2144186 Feb 17 18:07:15.928247 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf0f7fb4-38e5-4f80-8035-9fad299398d1 req-c50252af-403e-42a2-811d-6cd00f4585c3 service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1953301 Feb 17 18:07:16.106480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:16.176751 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ede3d76a-164d-4e7e-b5a1-55336c92a0b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:16.177790 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-adc0f75f-863d-4835-ab88-53e17782ec08 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:16.192297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4f22ba9a-e26f-4af3-b209-b01682732a9e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629551'] for security_group_rule, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:16.192778 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.005s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:16.199120 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853224169', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036854319422'] for network, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:16.232890 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning for port b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:07:16.238840 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:16.239270 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:16.263724 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:16.336823 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:16.342885 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f22ba9a-e26f-4af3-b209-b01682732a9e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fab7d4e3-ee5f-47d1-bb3d-b537a4fb92b1,revision_number=0']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:16.359102 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-4f22ba9a-e26f-4af3-b209-b01682732a9e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:16.359616 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a6dc4144-513d-483d-83ce-5eb47b6a5099 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.037s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:16.404605 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] 10.222.0.13 "DELETE /v2.0/networks/18109d6a-747c-4258-bd9e-533efa016ff4 HTTP/1.1" status: 204 len: 168 time: 6.2155666 Feb 17 18:07:16.466590 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-374ab607-6b2a-434d-a17e-cdbec0e6ff0b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:16.468483 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-374ab607-6b2a-434d-a17e-cdbec0e6ff0b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.70 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 819 time: 0.3163152 Feb 17 18:07:16.469755 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] Pushing event deleted for resources: {'Network': ['ID=18109d6a-747c-4258-bd9e-533efa016ff4,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:16.472712 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4f22ba9a-e26f-4af3-b209-b01682732a9e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group_rule, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:16.474129 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-4f22ba9a-e26f-4af3-b209-b01682732a9e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 2.5994651 Feb 17 18:07:16.475468 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d182dfd1-8bd5-4fc4-8b9d-bde395470150 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:16.484673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53806) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:16.490773 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Request body: {'port': {'device_id': 'a3149cc7-0c1b-4a08-848e-c50667987d6b', 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001', 'admin_state_up': True, 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:16.515264 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-e98f332c-c986-4f68-819e-ae0fd3db31da tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Request body: {'security_group_rule': {'security_group_id': '9fb6e7b2-439a-4b38-9765-cc107a9dfd37', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:16.522794 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e98f332c-c986-4f68-819e-ae0fd3db31da tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:16.527099 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e98f332c-c986-4f68-819e-ae0fd3db31da tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Usage tracker for resource:security_group_rule and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:16.530408 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e98f332c-c986-4f68-819e-ae0fd3db31da tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:16.536917 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e98f332c-c986-4f68-819e-ae0fd3db31da tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:16.677569 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:16.746074 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b8ff9d7a-1f7b-42c0-b8d1-1f882378df53', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3a26ef4-a85c-4cec-a049-f4b7fa8c6375'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:16.766791 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e98f332c-c986-4f68-819e-ae0fd3db31da tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group_rule, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:16.793330 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53814) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:16.842818 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-ede3d76a-164d-4e7e-b5a1-55336c92a0b1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f35180a462894998a7e87bd53145d440&name=default HTTP/1.1" status: 200 len: 2979 time: 2.6483901 Feb 17 18:07:16.854751 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53818) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:16.855465 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 3837ab39-c6c1-4f34-9b6b-47c98bdea645 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:16.922163 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ede3d76a-164d-4e7e-b5a1-55336c92a0b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca77c5bd-386e-4dcc-8594-334e2d83ba31,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:16.925297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-adc0f75f-863d-4835-ab88-53e17782ec08 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:16.929152 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-adc0f75f-863d-4835-ab88-53e17782ec08 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5a0f670d-2661-4bd4-ad3f-aa3224fdc93d HTTP/1.1" status: 204 len: 168 time: 2.0909801 Feb 17 18:07:16.966969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adc0f75f-863d-4835-ab88-53e17782ec08 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a0f670d-2661-4bd4-ad3f-aa3224fdc93d,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:16.972798 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6e1c35fa-42fb-404d-9af0-c2d308856202 req-91252008-4db7-4841-ba2e-2a0480c87132 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 210 time: 0.1302578 Feb 17 18:07:16.973793 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-adc0f75f-863d-4835-ab88-53e17782ec08 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.781s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:16.974564 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3338c888-0a5a-4608-b089-0fde74e3d56b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.754s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:16.975242 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3338c888-0a5a-4608-b089-0fde74e3d56b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:17.033504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93950b05-23fd-433b-aaca-217651aad901 req-0893623e-9ce5-414b-8191-04a69bbd6147 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:17.035173 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-93950b05-23fd-433b-aaca-217651aad901 req-0893623e-9ce5-414b-8191-04a69bbd6147 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 943 time: 0.7251854 Feb 17 18:07:17.070992 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port b3a26ef4-a85c-4cec-a049-f4b7fa8c6375, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=b3a26ef4-a85c-4cec-a049-f4b7fa8c6375,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:07:17.144332 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.145283 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:17.146834 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-93950b05-23fd-433b-aaca-217651aad901 req-45ed6bac-03cf-4b3c-af1a-d2bd70ee3f13 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0990536 Feb 17 18:07:17.180019 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-8a10a64d-3aef-44cf-84f3-498a3b33e3de admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=7a25651c22014108b99126a82207cf5b&name=default HTTP/1.1" status: 200 len: 2975 time: 0.3780005 Feb 17 18:07:17.185650 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e98f332c-c986-4f68-819e-ae0fd3db31da tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.189590 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53838) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:17.194368 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3e5e814c-9f0a-437f-aca5-44819cc88039 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.204248 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:17.207024 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:17.211227 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Usage tracker for resource:port and tenant:bda7a35e855840d7bc75e16e402f3690 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:17.215009 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Quota usage for port was recalculated. Used quota:1. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:17.265152 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.278702 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb1edf62-f67f-4fe0-939c-3fcffde8e65e req-297d4e23-9f27-4673-a6ad-0b2dfb31a4ad tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:17.280354 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fb1edf62-f67f-4fe0-939c-3fcffde8e65e req-297d4e23-9f27-4673-a6ad-0b2dfb31a4ad tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 946 time: 0.1156127 Feb 17 18:07:17.297375 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning for port 3837ab39-c6c1-4f34-9b6b-47c98bdea645 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:07:17.306272 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:17.311578 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3e5e814c-9f0a-437f-aca5-44819cc88039 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.323514 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 3837ab39-c6c1-4f34-9b6b-47c98bdea645 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:17.323973 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.350715 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e98f332c-c986-4f68-819e-ae0fd3db31da tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629551'] for security_group_rule, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.377292 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fb1edf62-f67f-4fe0-939c-3fcffde8e65e req-3cdc1297-2bda-49d4-8c49-271885bcbda2 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0883305 Feb 17 18:07:17.443042 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=b3a26ef4-a85c-4cec-a049-f4b7fa8c6375,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:17.447070 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:17.507696 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:17.524020 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.539843 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning for port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:07:17.550403 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:17.550996 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.621082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Made reservation on behalf of bda7a35e855840d7bc75e16e402f3690 for: {'port': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:07:17.627489 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.645201 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] For port 3837ab39-c6c1-4f34-9b6b-47c98bdea645, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=3837ab39-c6c1-4f34-9b6b-47c98bdea645,segment=NetworkSegment(a3b9a246-e8d6-47cc-bbb0-e0531b20a903),segment_id=a3b9a246-e8d6-47cc-bbb0-e0531b20a903)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:07:17.649249 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b8ff9d7a-1f7b-42c0-b8d1-1f882378df53', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3a26ef4-a85c-4cec-a049-f4b7fa8c6375', 'code': 200} Feb 17 18:07:17.685243 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e98f332c-c986-4f68-819e-ae0fd3db31da tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b8ad89ef-0cd7-4475-8789-0d16b1662d7f,revision_number=0']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:17.694619 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3e5e814c-9f0a-437f-aca5-44819cc88039 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.695609 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e98f332c-c986-4f68-819e-ae0fd3db31da tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:17.731631 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.732611 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 780be217-eb0a-4e51-a67c-6d7f3345b156 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:17.739833 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e98f332c-c986-4f68-819e-ae0fd3db31da tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group_rule, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.742401 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e98f332c-c986-4f68-819e-ae0fd3db31da tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.2572289 Feb 17 18:07:17.745125 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53864) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:17.745743 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ba0aa3e3-d370-4503-84c2-0ce1b9da4009 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.751147 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Request body: {'floatingip': {'floating_network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:17.766351 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:17.770495 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Usage tracker for resource:floatingip and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:17.781791 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:17.792820 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:17.804461 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:17.844480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for floatingip, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.923930 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Pushing event updated for resources: {'Port': ['ID=3837ab39-c6c1-4f34-9b6b-47c98bdea645,revision_number=5']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:17.942868 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:17.977094 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:17.983386 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9d978a71-3ae4-4635-96ab-f6eab94e24f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:18.006308 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ba0aa3e3-d370-4503-84c2-0ce1b9da4009 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:18.006517 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 780be217-eb0a-4e51-a67c-6d7f3345b156 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:18.006928 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:18.086968 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a,segment=NetworkSegment(c2d54292-0536-4a70-b118-0e7d52b9d0a7),segment_id=c2d54292-0536-4a70-b118-0e7d52b9d0a7)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:07:18.114936 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e5e814c-9f0a-437f-aca5-44819cc88039 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca77c5bd-386e-4dcc-8594-334e2d83ba31,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:18.132441 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3e5e814c-9f0a-437f-aca5-44819cc88039 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:18.148242 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3e5e814c-9f0a-437f-aca5-44819cc88039 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:18.174709 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3e5e814c-9f0a-437f-aca5-44819cc88039 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ca77c5bd-386e-4dcc-8594-334e2d83ba31 HTTP/1.1" status: 204 len: 168 time: 1.2673707 Feb 17 18:07:18.177931 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ba0aa3e3-d370-4503-84c2-0ce1b9da4009 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:18.210678 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ba0aa3e3-d370-4503-84c2-0ce1b9da4009 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:18.212050 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-ba0aa3e3-d370-4503-84c2-0ce1b9da4009 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/dfc3bd3a-afcf-4c5b-9bdb-9a49c7353a11 HTTP/1.1" status: 204 len: 168 time: 1.0198724 Feb 17 18:07:18.247616 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:18.253335 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:18.281804 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e210672a-bf1c-4314-95d2-324eb9176c56 req-25a68cd2-3f03-4af8-9c39-c4b2cdf05b83 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 210 time: 0.1066713 Feb 17 18:07:18.286942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:18.322752 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba0aa3e3-d370-4503-84c2-0ce1b9da4009 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dfc3bd3a-afcf-4c5b-9bdb-9a49c7353a11,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:18.330911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ba0aa3e3-d370-4503-84c2-0ce1b9da4009 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:18.346947 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-749b4c05-a47d-40c3-943f-340c10044b80 req-d8885cc7-7097-4a84-ba75-c238a9473682 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:18.351979 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-749b4c05-a47d-40c3-943f-340c10044b80 req-d8885cc7-7097-4a84-ba75-c238a9473682 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 1163 time: 0.3396852 Feb 17 18:07:18.358978 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Allocated IP 172.20.0.4 (4aaf4a03-4480-421f-bff4-f9814e969001/c04f01da-1295-4b8a-95ae-46589cb07040/c3de3799-da31-433f-9203-bfbce68f8d59) {{(pid=84112) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:07:18.427257 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-749b4c05-a47d-40c3-943f-340c10044b80 req-a5057088-d682-4755-99b6-4f262befe233 service neutron] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:18.442188 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:18.488439 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:18.491526 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-749b4c05-a47d-40c3-943f-340c10044b80 req-a5057088-d682-4755-99b6-4f262befe233 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:18.510472 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:18.513982 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-749b4c05-a47d-40c3-943f-340c10044b80 req-a5057088-d682-4755-99b6-4f262befe233 service neutron] Usage tracker for resource:security_group_rule and tenant:36b76b4b89a8462bad97c0308ef26020 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:18.519304 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-749b4c05-a47d-40c3-943f-340c10044b80 req-a5057088-d682-4755-99b6-4f262befe233 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:18.559113 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-749b4c05-a47d-40c3-943f-340c10044b80 req-a5057088-d682-4755-99b6-4f262befe233 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:18.567118 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:18.567619 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:18.610609 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:18.742839 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 3837ab39-c6c1-4f34-9b6b-47c98bdea645 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:18.854432 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:18.901429 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53900) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:18.916693 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks [] for port, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:18.928678 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 3837ab39-c6c1-4f34-9b6b-47c98bdea645 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:18.929493 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:18.949828 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.70', 63986) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:19.008161 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:19.008761 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:19.162116 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:19.174794 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-d4a3769f-e0d9-4adf-be2d-0940bc03f7c1 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:19.176195 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-d4a3769f-e0d9-4adf-be2d-0940bc03f7c1 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.70 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 819 time: 0.2253025 Feb 17 18:07:19.197633 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-93844c62-64ae-4daa-b592-44e47c465592 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:19.268119 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27b86be5-896e-477f-b29b-3e58e486476f req-78df5e31-324c-42cb-b2c7-5343cf6ae17b tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:19.270045 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-27b86be5-896e-477f-b29b-3e58e486476f req-78df5e31-324c-42cb-b2c7-5343cf6ae17b tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 946 time: 0.6641238 Feb 17 18:07:19.280056 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19d20a44-b842-4ba5-a934-057f8c8774c5 req-fb1e482f-72bd-40e6-9393-718545464d14 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:19.289259 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-19d20a44-b842-4ba5-a934-057f8c8774c5 req-fb1e482f-72bd-40e6-9393-718545464d14 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 945 time: 0.6183524 Feb 17 18:07:19.449724 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-749b4c05-a47d-40c3-943f-340c10044b80 req-a5057088-d682-4755-99b6-4f262befe233 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:19.464115 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-19d20a44-b842-4ba5-a934-057f8c8774c5 req-7da023e7-10f6-4124-a71c-44a777f572d1 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1737525 Feb 17 18:07:19.473043 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-27b86be5-896e-477f-b29b-3e58e486476f req-37c62771-2a04-4d45-b894-b1b56d1ae6b7 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1756215 Feb 17 18:07:19.536821 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-749b4c05-a47d-40c3-943f-340c10044b80 req-a5057088-d682-4755-99b6-4f262befe233 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:19.558378 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53920) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:19.558910 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53922) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:19.559531 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:19.602551 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5057088-d682-4755-99b6-4f262befe233 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=e4f5e49a-4117-4f3b-89cc-e2e44155809c,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:19.606882 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a5057088-d682-4755-99b6-4f262befe233 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:19.609601 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Request body: {'port': {'device_id': 'cf9e5a61-4f98-4cce-9af7-0a007d3afc36', 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001', 'admin_state_up': True, 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:19.645573 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c75f4d73-d1a5-40db-96d1-3daf0f50684a admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:19.650841 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0acf3623-ba41-4c0a-9078-ebe03ab82af3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:19.702113 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0acf3623-ba41-4c0a-9078-ebe03ab82af3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a', 'code': 200} Feb 17 18:07:19.720274 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c75f4d73-d1a5-40db-96d1-3daf0f50684a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:19.731054 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-749b4c05-a47d-40c3-943f-340c10044b80 req-a5057088-d682-4755-99b6-4f262befe233 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.3710408 Feb 17 18:07:19.744219 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c75f4d73-d1a5-40db-96d1-3daf0f50684a admin admin] Usage tracker for resource:security_group_rule and tenant:5700fc86886c47b58b3fd28a195e13a3 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:19.749649 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90732986-8d22-4605-bebd-01f599429dc6 req-1b856179-d0ec-4a0d-a680-bbf22e903fad tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 210 time: 0.1412761 Feb 17 18:07:19.750471 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c75f4d73-d1a5-40db-96d1-3daf0f50684a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:19.767588 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ea5766b6-2169-4976-ad2f-f5a41cc380d1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:19.773008 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c75f4d73-d1a5-40db-96d1-3daf0f50684a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:19.778098 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Allocated IP 172.27.1.57 (68fd415f-8606-43f8-b4d1-98e6a9c9af94/1c895d8f-55ff-4bdb-a323-742172b9934e/16675505-e920-4dc7-a789-c176aa44cd96) {{(pid=84111) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:07:19.810550 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-ea5766b6-2169-4976-ad2f-f5a41cc380d1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:19.819013 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-7f9a5a63-ec6e-4210-9134-9c8116d21c0c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=71a541d989bc494fbfa64e64c47d2209&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2214346 Feb 17 18:07:19.824192 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53934) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:19.827549 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-ea5766b6-2169-4976-ad2f-f5a41cc380d1 admin admin] Usage tracker for resource:security_group_rule and tenant:e4224fc274814cedb61940b15ad5df07 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:19.836273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-ea5766b6-2169-4976-ad2f-f5a41cc380d1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:19.841931 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Pushing event updated for resources: {'Port': ['ID=c3de3799-da31-433f-9203-bfbce68f8d59,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:19.861767 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.664s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:19.862652 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-ea5766b6-2169-4976-ad2f-f5a41cc380d1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:19.952537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:19.965334 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Network 4aaf4a03-4480-421f-bff4-f9814e969001 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:07:19.969706 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:07:19.974873 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Usage tracker for resource:port and tenant:bda7a35e855840d7bc75e16e402f3690 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:19.979259 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Received port after_create {{(pid=84112) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:07:20.041239 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Quota usage for port was recalculated. Used quota:2. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:20.050986 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-471bd1ed-84c2-4951-89fb-3ffabd2487ed admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.055844 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:20.062084 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:20.062860 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.123797 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for port, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.132079 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c75f4d73-d1a5-40db-96d1-3daf0f50684a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.132289 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.6507237 Feb 17 18:07:20.133028 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Made reservation on behalf of bda7a35e855840d7bc75e16e402f3690 for: {'port': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:07:20.134275 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-471bd1ed-84c2-4951-89fb-3ffabd2487ed admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.139481 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.160602 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c75f4d73-d1a5-40db-96d1-3daf0f50684a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.170842 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Request body: {'port': {'device_id': 'a3149cc7-0c1b-4a08-848e-c50667987d6b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:20.172569 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:20.249445 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ea5766b6-2169-4976-ad2f-f5a41cc380d1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.292839 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c75f4d73-d1a5-40db-96d1-3daf0f50684a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=089709c7-ec4c-4805-931e-54c007f66187,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:20.300505 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c75f4d73-d1a5-40db-96d1-3daf0f50684a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:20.308184 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c75f4d73-d1a5-40db-96d1-3daf0f50684a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5700fc86886c47b58b3fd28a195e13a3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7080097 Feb 17 18:07:20.308184 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 53952) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:20.336229 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ea5766b6-2169-4976-ad2f-f5a41cc380d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.379650 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed79bc0a-158e-453f-bf11-c64a30416631 req-05040bb3-0693-4118-8d0b-f1be5dfa10d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:20.381293 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ed79bc0a-158e-453f-bf11-c64a30416631 req-05040bb3-0693-4118-8d0b-f1be5dfa10d0 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 1162 time: 0.2124944 Feb 17 18:07:20.383340 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-471bd1ed-84c2-4951-89fb-3ffabd2487ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.387083 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.389851 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:20.396863 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:20.407299 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:20.474992 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.497467 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-ea5766b6-2169-4976-ad2f-f5a41cc380d1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e4224fc274814cedb61940b15ad5df07&name=default HTTP/1.1" status: 200 len: 2979 time: 1.5922322 Feb 17 18:07:20.497698 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-471bd1ed-84c2-4951-89fb-3ffabd2487ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e07ef398-1650-4d39-ae5c-a61272e8b63c,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:20.504186 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 53962) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:20.504915 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5766b6-2169-4976-ad2f-f5a41cc380d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d3237cf-fd5e-407f-b34e-3f99dd97dd2c,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:20.520969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ea5766b6-2169-4976-ad2f-f5a41cc380d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:20.524658 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-471bd1ed-84c2-4951-89fb-3ffabd2487ed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:20.544834 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.106s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:20.656515 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-5b30c4ff-7f93-46c5-8f71-0c05783fb824 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.783357 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:20.784243 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:20.989787 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6648c789-7d64-4ea2-8597-3789417129f1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:21.057664 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-ed79bc0a-158e-453f-bf11-c64a30416631 req-91c80246-666d-4421-b61e-97f2471f4b6d service neutron] Synchronizing usage tracker for tenant:36b76b4b89a8462bad97c0308ef26020 on resource:security_group {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:07:21.063292 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6648c789-7d64-4ea2-8597-3789417129f1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:21.066193 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-5b30c4ff-7f93-46c5-8f71-0c05783fb824 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:21.077826 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event updated for resources: {'Port': ['ID=16675505-e920-4dc7-a789-c176aa44cd96,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:21.093569 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Allocated IP 172.20.0.2 (4aaf4a03-4480-421f-bff4-f9814e969001/c04f01da-1295-4b8a-95ae-46589cb07040/bb98aa49-1c81-4cea-99cf-f201d19cfdae) {{(pid=84112) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:07:21.099980 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-471bd1ed-84c2-4951-89fb-3ffabd2487ed admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:21.101218 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-471bd1ed-84c2-4951-89fb-3ffabd2487ed admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e07ef398-1650-4d39-ae5c-a61272e8b63c HTTP/1.1" status: 204 len: 168 time: 1.2556298 Feb 17 18:07:21.110478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.562s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:21.221710 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 is already hosted by enough agents. {{(pid=84111) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:07:21.225667 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources bound (agent type, host, resource id): {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:07:21.229657 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-ed79bc0a-158e-453f-bf11-c64a30416631 req-91c80246-666d-4421-b61e-97f2471f4b6d service neutron] Unset dirty status for tenant:36b76b4b89a8462bad97c0308ef26020 on resource:security_group {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:07:21.230901 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ed79bc0a-158e-453f-bf11-c64a30416631 req-91c80246-666d-4421-b61e-97f2471f4b6d service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8321335 Feb 17 18:07:21.231847 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Received port after_create {{(pid=84111) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:07:21.240194 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6648c789-7d64-4ea2-8597-3789417129f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:21.252683 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca653c19-a66a-4e66-8810-96f2b993944e req-502b18e4-8acd-4909-bc76-f24d3cd7671a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:21.254308 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ca653c19-a66a-4e66-8810-96f2b993944e req-502b18e4-8acd-4909-bc76-f24d3cd7671a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 946 time: 0.5571673 Feb 17 18:07:21.262052 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:21.283094 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6648c789-7d64-4ea2-8597-3789417129f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d3237cf-fd5e-407f-b34e-3f99dd97dd2c,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:21.288782 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6648c789-7d64-4ea2-8597-3789417129f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:21.302002 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6648c789-7d64-4ea2-8597-3789417129f1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:21.306047 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-6648c789-7d64-4ea2-8597-3789417129f1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7d3237cf-fd5e-407f-b34e-3f99dd97dd2c HTTP/1.1" status: 204 len: 168 time: 0.7954230 Feb 17 18:07:21.383118 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e28b9a2-2eaa-4a1f-beab-5a7c8c6eb1ec req-eb2ce236-6f4f-4544-ab5b-f086e9942c5d tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:21.384836 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6e28b9a2-2eaa-4a1f-beab-5a7c8c6eb1ec req-eb2ce236-6f4f-4544-ab5b-f086e9942c5d tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 945 time: 0.3951542 Feb 17 18:07:21.386016 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for floatingip, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:21.387142 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks [] for port, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:21.420001 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ca653c19-a66a-4e66-8810-96f2b993944e req-78234760-a88e-442c-82b5-2a3af16b74c3 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1140335 Feb 17 18:07:21.446374 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-5b30c4ff-7f93-46c5-8f71-0c05783fb824 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:21.451240 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:21.476064 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6e28b9a2-2eaa-4a1f-beab-5a7c8c6eb1ec req-bcaa1a58-7ca3-4f6d-94a7-99fb0639ece3 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772426 Feb 17 18:07:21.523405 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:21.549012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:21.601339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:21.603674 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b30c4ff-7f93-46c5-8f71-0c05783fb824 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=089709c7-ec4c-4805-931e-54c007f66187,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:21.661435 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-5b30c4ff-7f93-46c5-8f71-0c05783fb824 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:21.784112 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-5b30c4ff-7f93-46c5-8f71-0c05783fb824 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:21.788470 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-5b30c4ff-7f93-46c5-8f71-0c05783fb824 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/089709c7-ec4c-4805-931e-54c007f66187 HTTP/1.1" status: 204 len: 168 time: 1.4771740 Feb 17 18:07:21.849200 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Pushing event updated for resources: {'Port': ['ID=bb98aa49-1c81-4cea-99cf-f201d19cfdae,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:21.858876 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:21.922365 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef498d0f-01ff-4734-8abf-e7b36fc90da2 req-b9ab2ee5-e259-4f0d-bc83-e00426f74c47 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:21.924242 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ef498d0f-01ff-4734-8abf-e7b36fc90da2 req-b9ab2ee5-e259-4f0d-bc83-e00426f74c47 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 931 time: 0.2616978 Feb 17 18:07:21.976115 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Network 4aaf4a03-4480-421f-bff4-f9814e969001 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:07:21.980292 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:07:21.985045 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Received port after_create {{(pid=84112) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:07:22.028339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54004) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:22.038848 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c3de3799-da31-433f-9203-bfbce68f8d59 {{(pid=84112) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:229}} Feb 17 18:07:22.051668 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Notify callbacks [] for port, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:22.072448 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:22.073121 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:22.080343 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Transition to ACTIVE for port object c3de3799-da31-433f-9203-bfbce68f8d59 will not be triggered until provisioned by entity L2. {{(pid=84112) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:07:22.080871 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-ef498d0f-01ff-4734-8abf-e7b36fc90da2 req-3d49a910-1304-418a-9701-f8fbf2d69bf1 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Synchronizing usage tracker for tenant:bda7a35e855840d7bc75e16e402f3690 on resource:security_group {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:07:22.087990 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-304edf8e-edcf-4656-875c-906813d459a8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:22.107327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:22.125110 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-619b50af-9ded-4d77-9b9a-555d00184729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:22.129945 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-304edf8e-edcf-4656-875c-906813d459a8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:22.138177 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-304edf8e-edcf-4656-875c-906813d459a8 admin admin] Usage tracker for resource:security_group_rule and tenant:47461507bff1403282de2c4ae4c2f0c5 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:22.142172 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-304edf8e-edcf-4656-875c-906813d459a8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:22.149647 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-304edf8e-edcf-4656-875c-906813d459a8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:22.183840 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-ef498d0f-01ff-4734-8abf-e7b36fc90da2 req-3d49a910-1304-418a-9701-f8fbf2d69bf1 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Unset dirty status for tenant:bda7a35e855840d7bc75e16e402f3690 on resource:security_group {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:07:22.185132 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ef498d0f-01ff-4734-8abf-e7b36fc90da2 req-3d49a910-1304-418a-9701-f8fbf2d69bf1 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2087250 Feb 17 18:07:22.200386 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for port, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:22.223013 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.0287039 Feb 17 18:07:22.239927 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:22.266828 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-52f091a7-b9cd-448a-a715-345303f7cd0b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:22.480857 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event updated for resources: {'Port': ['ID=16675505-e920-4dc7-a789-c176aa44cd96,revision_number=2']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:22.485196 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:22.508873 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-304edf8e-edcf-4656-875c-906813d459a8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:22.512286 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Request body: {'port': {'device_id': 'cf9e5a61-4f98-4cce-9af7-0a007d3afc36', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:22.546353 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036854376515'] for floatingip, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:22.582648 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-304edf8e-edcf-4656-875c-906813d459a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:22.697959 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Pushing event updated for resources: {'Port': ['ID=c3de3799-da31-433f-9203-bfbce68f8d59,revision_number=2']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:22.712926 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.587s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:22.735204 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-8b6bdae0-f608-4cce-93f7-ab09fbdfb27f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:22.751199 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-304edf8e-edcf-4656-875c-906813d459a8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=47461507bff1403282de2c4ae4c2f0c5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7170329 Feb 17 18:07:22.761771 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for floatingip, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:22.763018 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 5.0168030 Feb 17 18:07:22.774056 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54030) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:22.877149 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-304edf8e-edcf-4656-875c-906813d459a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be3d19b3-3c0b-435f-9299-38e0efa1f76b,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:22.891720 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-304edf8e-edcf-4656-875c-906813d459a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:22.899462 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:22.949088 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d3aa68da-066c-43aa-bd65-1e8da3ac4ed1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:22.977185 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e76dd6-1e4f-42cb-8299-fa8f0987b634 req-c8b83d74-5751-4398-9fe2-bfb5a20dd826 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:22.978805 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-72e76dd6-1e4f-42cb-8299-fa8f0987b634 req-c8b83d74-5751-4398-9fe2-bfb5a20dd826 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 946 time: 0.3263488 Feb 17 18:07:22.995817 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e5514f-5c77-4436-a0a5-255ee4079a0b req-796a8d08-2793-4a76-b6d8-638ba3d688ef tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:23.005435 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-09e5514f-5c77-4436-a0a5-255ee4079a0b req-796a8d08-2793-4a76-b6d8-638ba3d688ef tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 945 time: 0.2491527 Feb 17 18:07:23.051338 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d3aa68da-066c-43aa-bd65-1e8da3ac4ed1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:23.105638 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-09e5514f-5c77-4436-a0a5-255ee4079a0b req-6c82ad4f-f209-4cbe-8487-525a5d570a15 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1012664 Feb 17 18:07:23.184098 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-72e76dd6-1e4f-42cb-8299-fa8f0987b634 req-ed926f6e-cd15-4a33-93f4-00f3599474cf tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1753283 Feb 17 18:07:23.233009 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d3aa68da-066c-43aa-bd65-1e8da3ac4ed1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:23.238520 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3338c888-0a5a-4608-b089-0fde74e3d56b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:23.242118 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Attempting to bind port c3de3799-da31-433f-9203-bfbce68f8d59 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:07:23.242118 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Attempting to bind port c3de3799-da31-433f-9203-bfbce68f8d59 by drivers openvswitch on host hv-cinder-76019 at level 0 using segments [{'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:07:23.242848 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Attempting to bind port c3de3799-da31-433f-9203-bfbce68f8d59 on network 4aaf4a03-4480-421f-bff4-f9814e969001 {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:07:23.300190 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d3aa68da-066c-43aa-bd65-1e8da3ac4ed1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:23.301366 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-d3aa68da-066c-43aa-bd65-1e8da3ac4ed1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/be3d19b3-3c0b-435f-9299-38e0efa1f76b HTTP/1.1" status: 204 len: 168 time: 0.5248966 Feb 17 18:07:23.302337 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3aa68da-066c-43aa-bd65-1e8da3ac4ed1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be3d19b3-3c0b-435f-9299-38e0efa1f76b,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:23.306861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d3aa68da-066c-43aa-bd65-1e8da3ac4ed1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:23.316012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Checking agent: {'id': '35b9bf9c-0314-48b9-bb29-ba3a04c8b13c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 18, 4, 47), 'started_at': datetime.datetime(2021, 2, 17, 18, 5, 17), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 7, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.34', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:07:23.318647 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Checking segment: {'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'} for mappings: {} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:07:23.319162 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:23.319748 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Bound using segment: {'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:07:23.320949 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Bound port: c3de3799-da31-433f-9203-bfbce68f8d59, host: hv-cinder-76019, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'}}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:07:23.321796 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:23.376191 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-574aea75-f2a7-4abd-b12b-669d08c1a421 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Synchronizing usage tracker for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:security_group {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:07:23.461467 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-574aea75-f2a7-4abd-b12b-669d08c1a421 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Unset dirty status for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:security_group {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:07:23.463263 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-574aea75-f2a7-4abd-b12b-669d08c1a421 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--669436532&fields=id&tenant_id=bd48a3996f1246f1ab69d3866874af0b HTTP/1.1" status: 200 len: 267 time: 0.1953230 Feb 17 18:07:23.639989 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] For port c3de3799-da31-433f-9203-bfbce68f8d59, host hv-cinder-76019, cleared binding levels {{(pid=84112) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:07:23.654343 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] For port c3de3799-da31-433f-9203-bfbce68f8d59, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=c3de3799-da31-433f-9203-bfbce68f8d59,segment=NetworkSegment(eaf585ce-3bb4-4c27-942c-8aa396958840),segment_id=eaf585ce-3bb4-4c27-942c-8aa396958840)] {{(pid=84112) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:07:23.855972 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bb98aa49-1c81-4cea-99cf-f201d19cfdae {{(pid=84112) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:229}} Feb 17 18:07:23.864866 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:23.866847 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Notify callbacks [] for port, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:23.867605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2b06f874-6e10-4a14-a52f-f2bde32e9778 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:23.869335 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2b06f874-6e10-4a14-a52f-f2bde32e9778 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 813 time: 0.3984263 Feb 17 18:07:23.906149 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-b0d71eab-d7cf-441b-8984-8d54074351a2 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/quotas/bd48a3996f1246f1ab69d3866874af0b HTTP/1.1" status: 200 len: 375 time: 0.0259819 Feb 17 18:07:23.914159 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d00a448b-9377-4326-aa4a-15fa2c7a01fd req-f2483891-d2d2-4c5a-827f-e0ef24b505e2 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:23.919540 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d00a448b-9377-4326-aa4a-15fa2c7a01fd req-f2483891-d2d2-4c5a-827f-e0ef24b505e2 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 931 time: 0.4019434 Feb 17 18:07:24.046182 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:24.121926 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Transition to ACTIVE for port object bb98aa49-1c81-4cea-99cf-f201d19cfdae will not be triggered until provisioned by entity L2. {{(pid=84112) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:07:24.132070 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:24.135489 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:24.135489 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] 10.222.0.70 "PUT /v2.0/ports/c3de3799-da31-433f-9203-bfbce68f8d59 HTTP/1.1" status: 200 len: 1157 time: 3.9711347 Feb 17 18:07:24.135489 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a3149cc7-0c1b-4a08-848e-c50667987d6b', 'tag': 'c3de3799-da31-433f-9203-bfbce68f8d59'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:24.166520 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:24.194163 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d00a448b-9377-4326-aa4a-15fa2c7a01fd req-cab44597-b414-4468-808c-e39756b75f77 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2679532 Feb 17 18:07:24.231471 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-01df8a9d-6529-4c4d-9779-bde2b301e15f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.3032372 Feb 17 18:07:24.353885 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Pushing event updated for resources: {'Port': ['ID=c3de3799-da31-433f-9203-bfbce68f8d59,revision_number=3']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:24.381561 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a3149cc7-0c1b-4a08-848e-c50667987d6b', 'tag': 'c3de3799-da31-433f-9203-bfbce68f8d59', 'status': 'completed', 'code': 200} Feb 17 18:07:24.433579 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.387s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:24.502937 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.073s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:24.598721 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-18403f01-044a-43b0-b4b2-64a7cbe30799 service neutron] 10.222.0.13 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3346286 Feb 17 18:07:24.668829 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Pushing event updated for resources: {'Port': ['ID=bb98aa49-1c81-4cea-99cf-f201d19cfdae,revision_number=2']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:24.674518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:24.735736 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-0e54c662-189e-4fef-a8ae-fdf02af166e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:24.737920 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-0e54c662-189e-4fef-a8ae-fdf02af166e3 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 1160 time: 0.3094308 Feb 17 18:07:24.798888 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-5f585c52-7471-4a2d-9922-89f8cca5dbbe service neutron] 10.222.0.13 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1965048 Feb 17 18:07:24.833614 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-ebe309e9-5748-4e0a-bdb4-bf94b264f9d3 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c3de3799-da31-433f-9203-bfbce68f8d59 HTTP/1.1" status: 200 len: 217 time: 0.0766063 Feb 17 18:07:24.834477 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Attempting to bind port bb98aa49-1c81-4cea-99cf-f201d19cfdae on host hv-cinder-76019 for vnic_type normal with profile {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:07:24.834852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Attempting to bind port bb98aa49-1c81-4cea-99cf-f201d19cfdae by drivers openvswitch on host hv-cinder-76019 at level 0 using segments [{'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:07:24.835218 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Attempting to bind port bb98aa49-1c81-4cea-99cf-f201d19cfdae on network 4aaf4a03-4480-421f-bff4-f9814e969001 {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:07:24.842678 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Checking agent: {'id': '35b9bf9c-0314-48b9-bb29-ba3a04c8b13c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 18, 4, 47), 'started_at': datetime.datetime(2021, 2, 17, 18, 5, 17), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 7, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.34', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:07:24.843057 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Checking segment: {'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'} for mappings: {} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:07:24.843463 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:24.844157 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Bound using segment: {'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:07:24.844641 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Bound port: bb98aa49-1c81-4cea-99cf-f201d19cfdae, host: hv-cinder-76019, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eaf585ce-3bb4-4c27-942c-8aa396958840', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 3, 'network_id': '4aaf4a03-4480-421f-bff4-f9814e969001'}}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:07:24.845020 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:24.980662 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-25f6804c-ce80-4e22-83aa-de69bed97be6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:24.982286 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-25f6804c-ce80-4e22-83aa-de69bed97be6 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=c04f01da-1295-4b8a-95ae-46589cb07040 HTTP/1.1" status: 200 len: 859 time: 0.1409426 Feb 17 18:07:25.053864 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-037a0ead-27c3-4656-9a7a-9590b11be68e service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4aaf4a03-4480-421f-bff4-f9814e969001&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0569215 Feb 17 18:07:25.058504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] For port bb98aa49-1c81-4cea-99cf-f201d19cfdae, host hv-cinder-76019, cleared binding levels {{(pid=84112) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:07:25.113821 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:07:25.121291 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54118) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:25.141845 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] For port bb98aa49-1c81-4cea-99cf-f201d19cfdae, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=bb98aa49-1c81-4cea-99cf-f201d19cfdae,segment=NetworkSegment(eaf585ce-3bb4-4c27-942c-8aa396958840),segment_id=eaf585ce-3bb4-4c27-942c-8aa396958840)] {{(pid=84112) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:07:25.145996 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-09422a17-4fb8-4826-9df3-01fa9931b3cc req-b50bd815-0836-41c8-a283-85220da84318 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 210 time: 0.0865405 Feb 17 18:07:25.186491 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:25.209290 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fbd4708b-6c2f-4e08-a1b1-e24acdaaf7ae tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:25.382830 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-8f743c41-4bfc-4e93-b6f4-5f069c0377b2 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3203709 Feb 17 18:07:25.473640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Pushing event updated for resources: {'Port': ['ID=bb98aa49-1c81-4cea-99cf-f201d19cfdae,revision_number=3']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:25.503232 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.294s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:25.562372 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-25765972-cb0a-4651-9000-feb0c4a5f93e admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:25.602485 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:25.616991 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:25.622178 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] 10.222.0.70 "PUT /v2.0/ports/bb98aa49-1c81-4cea-99cf-f201d19cfdae HTTP/1.1" status: 200 len: 1157 time: 3.1517079 Feb 17 18:07:25.645283 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dadd1178-b6fd-4ccf-ab09-1f8bc113a882 req-da00647c-290a-4be3-b12d-23fa032e5303 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:25.648498 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-dadd1178-b6fd-4ccf-ab09-1f8bc113a882 req-da00647c-290a-4be3-b12d-23fa032e5303 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 943 time: 0.2935145 Feb 17 18:07:25.653083 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-25765972-cb0a-4651-9000-feb0c4a5f93e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:25.662152 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-25765972-cb0a-4651-9000-feb0c4a5f93e admin admin] Usage tracker for resource:security_group_rule and tenant:81feca5739ae481998abac68d3c4cb59 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:25.666882 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-778fcae1-db1f-4e33-9e19-0ba9d3c27e88 req-c963377c-e97d-44af-8941-ebc2aa4c4c5f service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2741950 Feb 17 18:07:25.670586 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-25765972-cb0a-4651-9000-feb0c4a5f93e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:25.678114 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-25765972-cb0a-4651-9000-feb0c4a5f93e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:25.753163 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-dadd1178-b6fd-4ccf-ab09-1f8bc113a882 req-968a14dc-b5ea-4409-90d5-19b0a1d79abc tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740042 Feb 17 18:07:26.032171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-25765972-cb0a-4651-9000-feb0c4a5f93e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:26.090390 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-25765972-cb0a-4651-9000-feb0c4a5f93e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:26.121308 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:26.131454 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-25765972-cb0a-4651-9000-feb0c4a5f93e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=81feca5739ae481998abac68d3c4cb59&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0032969 Feb 17 18:07:26.137432 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54168) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:26.186065 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25765972-cb0a-4651-9000-feb0c4a5f93e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bf6c4095-eeaa-4c92-b5cc-d0e784a5b5ab,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:26.191624 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-25765972-cb0a-4651-9000-feb0c4a5f93e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:26.201117 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-ae7fe2ca-7186-4cea-9b14-c2d555114d7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:26.202745 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-ae7fe2ca-7186-4cea-9b14-c2d555114d7c service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 1160 time: 0.4881272 Feb 17 18:07:26.205071 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecd03e1-4831-418e-91c7-b72bf535e745 req-84b5b653-34b9-42d7-9836-4ff0a2dd7c32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:26.206439 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8ecd03e1-4831-418e-91c7-b72bf535e745 req-84b5b653-34b9-42d7-9836-4ff0a2dd7c32 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 1160 time: 0.4432056 Feb 17 18:07:26.252991 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-24519877-d70d-4886-832b-e889702a921c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:26.311173 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-24519877-d70d-4886-832b-e889702a921c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:26.332191 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-8eaca418-29c4-412b-891f-371d6f92742a service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=bb98aa49-1c81-4cea-99cf-f201d19cfdae HTTP/1.1" status: 200 len: 217 time: 0.1124461 Feb 17 18:07:26.388362 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cf9e5a61-4f98-4cce-9af7-0a007d3afc36', 'tag': 'bb98aa49-1c81-4cea-99cf-f201d19cfdae'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:26.501588 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-3f20443a-4e6c-4c39-b8de-efdcabe1658d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:26.503192 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-3f20443a-4e6c-4c39-b8de-efdcabe1658d service neutron] 10.222.0.70 "GET /v2.0/subnets?id=c04f01da-1295-4b8a-95ae-46589cb07040 HTTP/1.1" status: 200 len: 859 time: 0.1038048 Feb 17 18:07:26.570281 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-24519877-d70d-4886-832b-e889702a921c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:26.575064 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-99101238-5287-4948-a47e-2f336e149a99 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:26.588793 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-01f7e83e-b0bf-4ca4-9624-649f03541076 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4aaf4a03-4480-421f-bff4-f9814e969001&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0772402 Feb 17 18:07:26.593859 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecd03e1-4831-418e-91c7-b72bf535e745 req-1f536aa8-3228-4014-b08f-3a02fc246877 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:26.595366 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8ecd03e1-4831-418e-91c7-b72bf535e745 req-1f536aa8-3228-4014-b08f-3a02fc246877 service neutron] 10.222.0.70 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 913 time: 0.3080544 Feb 17 18:07:26.600174 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24519877-d70d-4886-832b-e889702a921c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf6c4095-eeaa-4c92-b5cc-d0e784a5b5ab,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:26.605099 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-24519877-d70d-4886-832b-e889702a921c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:26.616174 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-24519877-d70d-4886-832b-e889702a921c admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:26.628184 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-24519877-d70d-4886-832b-e889702a921c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/bf6c4095-eeaa-4c92-b5cc-d0e784a5b5ab HTTP/1.1" status: 204 len: 168 time: 0.4841447 Feb 17 18:07:26.773618 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8ecd03e1-4831-418e-91c7-b72bf535e745 req-b12f1a0a-cf5a-4f1d-a1fe-edcf9e72fc53 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c3de3799-da31-433f-9203-bfbce68f8d59 HTTP/1.1" status: 200 len: 217 time: 0.1413405 Feb 17 18:07:26.939644 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecd03e1-4831-418e-91c7-b72bf535e745 req-5098361c-77f3-4297-a98d-4f4c7879504a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:26.941507 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8ecd03e1-4831-418e-91c7-b72bf535e745 req-5098361c-77f3-4297-a98d-4f4c7879504a service neutron] 10.222.0.70 "GET /v2.0/subnets?id=c04f01da-1295-4b8a-95ae-46589cb07040 HTTP/1.1" status: 200 len: 859 time: 0.1608889 Feb 17 18:07:26.945005 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-d50b2bd6-a88b-4ce8-9383-340d10653ae2 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3486853 Feb 17 18:07:27.049599 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b65c4a7e-0bd2-4d8a-8a1c-f61d6cdcd3e5 req-7fda2846-6773-419b-a59a-062e9376c37b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 210 time: 0.0674024 Feb 17 18:07:27.116048 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cf9e5a61-4f98-4cce-9af7-0a007d3afc36', 'tag': 'bb98aa49-1c81-4cea-99cf-f201d19cfdae', 'status': 'completed', 'code': 200} Feb 17 18:07:27.130206 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8ecd03e1-4831-418e-91c7-b72bf535e745 req-e00ff4c3-74b9-4e81-8e27-a7ffe4e0fd4c service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4aaf4a03-4480-421f-bff4-f9814e969001&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1761665 Feb 17 18:07:27.328171 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8ecd03e1-4831-418e-91c7-b72bf535e745 req-afbcb23e-4b51-4d59-887b-d0e4cb0f7494 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1867774 Feb 17 18:07:27.345193 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c88a6ff-936d-497c-964f-a2288748aa2d req-78f07f0b-50cc-42b2-baf5-fc23ab2d4f83 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:27.353806 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6c88a6ff-936d-497c-964f-a2288748aa2d req-78f07f0b-50cc-42b2-baf5-fc23ab2d4f83 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 943 time: 0.1688030 Feb 17 18:07:27.500368 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3107910a-0ba5-44d7-9cbe-0b1a94e85399 req-30d664e1-e8b1-4965-99ae-489b9c97a0bd service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.4859889 Feb 17 18:07:27.543708 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8ecd03e1-4831-418e-91c7-b72bf535e745 req-9ee6b9d2-a6b5-4b28-8718-13b13b6ae578 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2079966 Feb 17 18:07:27.673447 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6c88a6ff-936d-497c-964f-a2288748aa2d req-b0c8395f-ed02-4249-b637-fc282b0b0c2e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3147781 Feb 17 18:07:27.685081 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54218) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:27.709279 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1dcc82ac-d560-4581-a833-bf468a6da46b admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:27.729537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-1dcc82ac-d560-4581-a833-bf468a6da46b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:27.733567 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-1dcc82ac-d560-4581-a833-bf468a6da46b admin admin] Usage tracker for resource:security_group_rule and tenant:0fad680b1be34a7aa7b6548d341b6644 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:27.736668 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-1dcc82ac-d560-4581-a833-bf468a6da46b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:27.742629 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-1dcc82ac-d560-4581-a833-bf468a6da46b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:27.869870 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aed5858-7a34-48fd-b68e-a9be56e46814 req-b97f93a9-a7a7-40a2-b7e7-b6f043f155b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:27.871516 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1aed5858-7a34-48fd-b68e-a9be56e46814 req-b97f93a9-a7a7-40a2-b7e7-b6f043f155b6 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 1160 time: 0.2755752 Feb 17 18:07:27.903355 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1dcc82ac-d560-4581-a833-bf468a6da46b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:27.924016 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1dcc82ac-d560-4581-a833-bf468a6da46b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:27.933347 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:27.946296 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54226) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:27.972251 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-9b024327-b719-42c5-9a58-b03452e7db32 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:27.973222 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-9b024327-b719-42c5-9a58-b03452e7db32 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Synchronizing usage tracker for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:network {{(pid=84112) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:07:28.020543 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-1dcc82ac-d560-4581-a833-bf468a6da46b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0fad680b1be34a7aa7b6548d341b6644&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3339689 Feb 17 18:07:28.022082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54236) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:28.046893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dcc82ac-d560-4581-a833-bf468a6da46b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9bf4e7c-a05b-4d4d-a55d-ecb0ebbd16d3,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:28.070658 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1dcc82ac-d560-4581-a833-bf468a6da46b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:28.096308 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-9b024327-b719-42c5-9a58-b03452e7db32 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Unset dirty status for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:network {{(pid=84112) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:07:28.101338 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-9b024327-b719-42c5-9a58-b03452e7db32 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.70 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 813 time: 0.4475100 Feb 17 18:07:28.136234 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f46aa90e-44d3-4da8-9001-5ebcac5a31e0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:28.178038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aed5858-7a34-48fd-b68e-a9be56e46814 req-412da968-11d1-4dda-99b5-35e4431fb694 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:28.179646 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1aed5858-7a34-48fd-b68e-a9be56e46814 req-412da968-11d1-4dda-99b5-35e4431fb694 service neutron] 10.222.0.70 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 913 time: 0.2956479 Feb 17 18:07:28.184414 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f46aa90e-44d3-4da8-9001-5ebcac5a31e0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:28.277841 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3c88ca9c-477f-4490-84fc-71e51ceb4e91 req-6ee31d74-a5fa-4973-b046-ae6ea4059192 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 210 time: 0.0646458 Feb 17 18:07:28.333626 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-ae2a2456-806d-4b6d-8323-b54361d188d2 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Synchronizing usage tracker for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:security_group {{(pid=84112) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:07:28.348841 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-ae2a2456-806d-4b6d-8323-b54361d188d2 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Unset dirty status for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:security_group {{(pid=84112) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:07:28.350210 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-ae2a2456-806d-4b6d-8323-b54361d188d2 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=bd48a3996f1246f1ab69d3866874af0b HTTP/1.1" status: 200 len: 5703 time: 0.2261174 Feb 17 18:07:28.365017 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1aed5858-7a34-48fd-b68e-a9be56e46814 req-7ce52b9f-60e1-4312-93f6-c0ff307ba4b2 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=bb98aa49-1c81-4cea-99cf-f201d19cfdae HTTP/1.1" status: 200 len: 217 time: 0.1522567 Feb 17 18:07:28.372741 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Request body: {'port': {'device_id': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'admin_state_up': True, 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'security_groups': ['9fb6e7b2-439a-4b38-9765-cc107a9dfd37']}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:28.410354 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f46aa90e-44d3-4da8-9001-5ebcac5a31e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:28.417496 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d3aa68da-066c-43aa-bd65-1e8da3ac4ed1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:28.436576 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f46aa90e-44d3-4da8-9001-5ebcac5a31e0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9bf4e7c-a05b-4d4d-a55d-ecb0ebbd16d3,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:28.490081 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f46aa90e-44d3-4da8-9001-5ebcac5a31e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:28.496855 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f46aa90e-44d3-4da8-9001-5ebcac5a31e0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:28.500904 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f46aa90e-44d3-4da8-9001-5ebcac5a31e0 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a9bf4e7c-a05b-4d4d-a55d-ecb0ebbd16d3 HTTP/1.1" status: 204 len: 168 time: 0.4738848 Feb 17 18:07:28.508960 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e791ed17-f14a-4adf-9eea-47119b04466e admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:28.536884 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e791ed17-f14a-4adf-9eea-47119b04466e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:28.544734 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aed5858-7a34-48fd-b68e-a9be56e46814 req-666125b4-e3c3-44cd-8c1c-983bd830236e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:28.546264 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1aed5858-7a34-48fd-b68e-a9be56e46814 req-666125b4-e3c3-44cd-8c1c-983bd830236e service neutron] 10.222.0.70 "GET /v2.0/subnets?id=c04f01da-1295-4b8a-95ae-46589cb07040 HTTP/1.1" status: 200 len: 859 time: 0.1554310 Feb 17 18:07:28.547989 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e791ed17-f14a-4adf-9eea-47119b04466e admin admin] Usage tracker for resource:security_group_rule and tenant:1f0b8b759e1e4e4ba67a4346e9e6eaac is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:28.551900 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e791ed17-f14a-4adf-9eea-47119b04466e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:28.560645 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e791ed17-f14a-4adf-9eea-47119b04466e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:28.652936 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.objects.ports [None req-5fb997f7-ab57-412b-8ed5-8042c8bdf1fa None None] Time-cost: Fetching 2 ports in 1 security groups {{(pid=84113) get_objects /opt/stack/neutron/neutron/objects/ports.py:431}} Feb 17 18:07:28.670951 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1aed5858-7a34-48fd-b68e-a9be56e46814 req-6c579595-2c95-4081-b0dd-85d1505f9442 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4aaf4a03-4480-421f-bff4-f9814e969001&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1165359 Feb 17 18:07:28.717538 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e791ed17-f14a-4adf-9eea-47119b04466e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:28.741408 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e791ed17-f14a-4adf-9eea-47119b04466e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:28.757771 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a5057088-d682-4755-99b6-4f262befe233 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:28.775765 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:28.779910 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Usage tracker for resource:port and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:28.782916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Quota usage for port was recalculated. Used quota:3. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:28.788694 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:28.825348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Made reservation on behalf of bd48a3996f1246f1ab69d3866874af0b for: {'port': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:07:28.831205 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:28.886801 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e791ed17-f14a-4adf-9eea-47119b04466e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1f0b8b759e1e4e4ba67a4346e9e6eaac&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9394000 Feb 17 18:07:28.890241 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e791ed17-f14a-4adf-9eea-47119b04466e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e234bcd5-2271-44f2-a154-34339904d571,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:28.895526 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 54268) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:28.911708 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e791ed17-f14a-4adf-9eea-47119b04466e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:28.946496 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76a2592-c968-42a1-a101-e29756034cf9 req-137d5877-4987-4942-8338-603c014bfba9 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:28.948737 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e76a2592-c968-42a1-a101-e29756034cf9 req-137d5877-4987-4942-8338-603c014bfba9 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 943 time: 0.1500378 Feb 17 18:07:29.016784 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e76a2592-c968-42a1-a101-e29756034cf9 req-f90bc9a2-c5dd-42e6-826e-22861a8b7737 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548956 Feb 17 18:07:29.095088 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:29.198649 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1aed5858-7a34-48fd-b68e-a9be56e46814 req-2ecf7ad7-4fbb-4dd3-a60e-822b643e41bc service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5091696 Feb 17 18:07:29.216060 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning for port c3de3799-da31-433f-9203-bfbce68f8d59 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:07:29.224069 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port c3de3799-da31-433f-9203-bfbce68f8d59 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:29.224715 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:29.387050 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a4815389-1e13-45e9-81dc-2039c73db9e6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:29.433002 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:29.501160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port c3de3799-da31-433f-9203-bfbce68f8d59, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=c3de3799-da31-433f-9203-bfbce68f8d59,segment=NetworkSegment(eaf585ce-3bb4-4c27-942c-8aa396958840),segment_id=eaf585ce-3bb4-4c27-942c-8aa396958840)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:07:29.503131 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bc4a7502-e46b-4e8e-9bb0-19fb5b483eae req-bdafee79-a223-468c-bfef-5cda63aeb334 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 210 time: 0.0745568 Feb 17 18:07:29.503322 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a3149cc7-0c1b-4a08-848e-c50667987d6b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c3de3799-da31-433f-9203-bfbce68f8d59'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:29.541917 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:29.544140 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-4a35fdfc-3d7d-4e63-a298-77456e578c9a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:29.577143 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a4815389-1e13-45e9-81dc-2039c73db9e6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:29.650015 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a3149cc7-0c1b-4a08-848e-c50667987d6b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c3de3799-da31-433f-9203-bfbce68f8d59', 'code': 200} Feb 17 18:07:29.699772 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=c3de3799-da31-433f-9203-bfbce68f8d59,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:29.704155 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:29.735185 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a4815389-1e13-45e9-81dc-2039c73db9e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:29.758754 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:29.778979 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4815389-1e13-45e9-81dc-2039c73db9e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e234bcd5-2271-44f2-a154-34339904d571,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:29.787701 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a4815389-1e13-45e9-81dc-2039c73db9e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:29.801263 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1aed5858-7a34-48fd-b68e-a9be56e46814 req-809fe217-8b73-459c-abc4-53e873fe0934 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.5785182 Feb 17 18:07:29.802062 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a4815389-1e13-45e9-81dc-2039c73db9e6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:29.806615 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-a4815389-1e13-45e9-81dc-2039c73db9e6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e234bcd5-2271-44f2-a154-34339904d571 HTTP/1.1" status: 204 len: 168 time: 0.9111092 Feb 17 18:07:29.809015 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Allocated IP 172.20.0.4 (8e56c377-33ba-47b0-9d75-fa2421d9f1e2/2f43211a-7773-487d-8b86-a136c7f7c156/e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89) {{(pid=84112) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:07:30.089385 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58482ffa-f51d-4405-9301-3a488273b15c req-9cf62674-1679-43d4-8d6d-1c8f9bb554f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:30.091022 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-58482ffa-f51d-4405-9301-3a488273b15c req-9cf62674-1679-43d4-8d6d-1c8f9bb554f4 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 1162 time: 0.2217708 Feb 17 18:07:30.133685 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for port, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:30.165357 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Transition to ACTIVE for port object e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 will not be triggered until provisioned by entity DHCP. {{(pid=84112) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:07:30.167823 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-58482ffa-f51d-4405-9301-3a488273b15c req-6b2c346c-05dd-434d-98c8-5646d24aaa80 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684683 Feb 17 18:07:30.221873 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:30.239777 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:30.266787 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0189949c-8b06-4675-8428-38ef5539fcc1 req-f63e2f5b-efe7-4b02-b194-8ee3f99aa209 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:30.274592 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0189949c-8b06-4675-8428-38ef5539fcc1 req-f63e2f5b-efe7-4b02-b194-8ee3f99aa209 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 943 time: 0.1107280 Feb 17 18:07:30.333790 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0189949c-8b06-4675-8428-38ef5539fcc1 req-f75b6958-ae15-4fee-8a77-138a0cd61ac3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576723 Feb 17 18:07:30.394781 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event updated for resources: {'Port': ['ID=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:30.398032 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:30.464782 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:07:30.466339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:07:30.469078 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Received port after_create {{(pid=84112) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:07:30.482868 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54336) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:30.580335 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:30.581082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:30.650376 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54346) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:30.684051 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-de3503d5-b889-4ffa-8992-700c5f835b9d admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:30.691095 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-06247980-3d9a-442e-8a02-f3113e3eae30 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3278711 Feb 17 18:07:30.705982 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Request body: {'port': {'device_id': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:30.759061 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-ad3b5141-1a58-45b5-91b7-0267b23d0a31 None None] Provisioning for port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 completed by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:07:30.765041 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-ad3b5141-1a58-45b5-91b7-0267b23d0a31 None None] Provisioning complete for port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:30.765463 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ad3b5141-1a58-45b5-91b7-0267b23d0a31 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:30.797751 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-de3503d5-b889-4ffa-8992-700c5f835b9d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:30.802112 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-de3503d5-b889-4ffa-8992-700c5f835b9d admin admin] Usage tracker for resource:security_group_rule and tenant:3655944bc25e4a60bd8ed049f8f93287 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:30.805445 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-de3503d5-b889-4ffa-8992-700c5f835b9d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:30.812393 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-de3503d5-b889-4ffa-8992-700c5f835b9d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:30.858480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-ad3b5141-1a58-45b5-91b7-0267b23d0a31 None None] Port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 cannot update to ACTIVE because it is not bound. {{(pid=84113) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:332}} Feb 17 18:07:30.918317 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:30.923272 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5209a24-cd1f-4b34-abf2-86082390a57f req-07cc897a-676e-4b0d-8aa1-9fd1a686e43b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:30.932252 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c5209a24-cd1f-4b34-abf2-86082390a57f req-07cc897a-676e-4b0d-8aa1-9fd1a686e43b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 931 time: 0.2112556 Feb 17 18:07:30.985727 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-de3503d5-b889-4ffa-8992-700c5f835b9d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.006857 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c5209a24-cd1f-4b34-abf2-86082390a57f req-0ef65631-2768-43f9-bbe4-e89df252e91a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0733831 Feb 17 18:07:31.043098 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-de3503d5-b889-4ffa-8992-700c5f835b9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.043641 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device bb98aa49-1c81-4cea-99cf-f201d19cfdae up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:31.075497 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-5b30c4ff-7f93-46c5-8f71-0c05783fb824 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:31.107223 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-de3503d5-b889-4ffa-8992-700c5f835b9d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=3655944bc25e4a60bd8ed049f8f93287&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4553308 Feb 17 18:07:31.108601 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e8ed8b3f-ebe9-48dc-be27-24431528fca6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.110282 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 54354) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:31.121820 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de3503d5-b889-4ffa-8992-700c5f835b9d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f392e3c-77a4-428f-8b59-802ce123fefc,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:31.128606 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-de3503d5-b889-4ffa-8992-700c5f835b9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:31.134034 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e8ed8b3f-ebe9-48dc-be27-24431528fca6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:31.137352 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e8ed8b3f-ebe9-48dc-be27-24431528fca6 admin admin] Usage tracker for resource:security_group_rule and tenant:b0581f22c0df4a4897c0f0cb6af1c7a2 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:31.140869 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e8ed8b3f-ebe9-48dc-be27-24431528fca6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:31.146833 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e8ed8b3f-ebe9-48dc-be27-24431528fca6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:31.181718 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning for port bb98aa49-1c81-4cea-99cf-f201d19cfdae completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:07:31.187749 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port bb98aa49-1c81-4cea-99cf-f201d19cfdae triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:31.188207 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.244181 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e8ed8b3f-ebe9-48dc-be27-24431528fca6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.278723 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e8ed8b3f-ebe9-48dc-be27-24431528fca6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.301555 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-de3503d5-b889-4ffa-8992-700c5f835b9d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:31.358447 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-437a4ee5-0a3a-47b1-a238-e823e78a406b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.375658 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e8ed8b3f-ebe9-48dc-be27-24431528fca6 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b0581f22c0df4a4897c0f0cb6af1c7a2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8916199 Feb 17 18:07:31.376722 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54368) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:31.382153 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8ed8b3f-ebe9-48dc-be27-24431528fca6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c14e098-e9e4-42e6-960a-3ff0aca15760,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:31.390965 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e8ed8b3f-ebe9-48dc-be27-24431528fca6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:31.410086 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-437a4ee5-0a3a-47b1-a238-e823e78a406b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.512194 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-437a4ee5-0a3a-47b1-a238-e823e78a406b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.530034 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1ce48b06-9cdf-47eb-bb86-c518fe399213 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:31.546740 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-437a4ee5-0a3a-47b1-a238-e823e78a406b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f392e3c-77a4-428f-8b59-802ce123fefc,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:31.563887 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-437a4ee5-0a3a-47b1-a238-e823e78a406b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:31.588169 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-437a4ee5-0a3a-47b1-a238-e823e78a406b admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.592658 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-437a4ee5-0a3a-47b1-a238-e823e78a406b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5f392e3c-77a4-428f-8b59-802ce123fefc HTTP/1.1" status: 204 len: 168 time: 0.4811780 Feb 17 18:07:31.623762 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fc5946aa-3027-4bf6-8829-e136fd0b7358 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.656379 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.716589 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 {{(pid=84112) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:229}} Feb 17 18:07:31.719993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port bb98aa49-1c81-4cea-99cf-f201d19cfdae, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=bb98aa49-1c81-4cea-99cf-f201d19cfdae,segment=NetworkSegment(eaf585ce-3bb4-4c27-942c-8aa396958840),segment_id=eaf585ce-3bb4-4c27-942c-8aa396958840)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:07:31.722064 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf9e5a61-4f98-4cce-9af7-0a007d3afc36', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb98aa49-1c81-4cea-99cf-f201d19cfdae'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:31.739594 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fc5946aa-3027-4bf6-8829-e136fd0b7358 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.742561 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Notify callbacks [] for port, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.758554 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.760524 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:31.777074 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Transition to ACTIVE for port object e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 will not be triggered until provisioned by entity L2. {{(pid=84112) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:07:31.800676 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf9e5a61-4f98-4cce-9af7-0a007d3afc36', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb98aa49-1c81-4cea-99cf-f201d19cfdae', 'code': 200} Feb 17 18:07:31.801176 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:31.833064 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:31.863327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:31.877671 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5bcde15-c91d-46c5-825f-b99ce80b5763 req-48a98c7d-5fa4-4080-9d4e-1d6ba95240fe tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:31.885451 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c5bcde15-c91d-46c5-825f-b99ce80b5763 req-48a98c7d-5fa4-4080-9d4e-1d6ba95240fe tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 943 time: 0.2628217 Feb 17 18:07:32.013800 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=bb98aa49-1c81-4cea-99cf-f201d19cfdae,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:32.027277 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:32.028843 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port c3de3799-da31-433f-9203-bfbce68f8d59 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:32.042486 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c5bcde15-c91d-46c5-825f-b99ce80b5763 req-19a2ae84-ff4a-4ff4-91c0-44cd32b512cf tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1267862 Feb 17 18:07:32.042486 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fc5946aa-3027-4bf6-8829-e136fd0b7358 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:32.046782 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:32.050793 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:32.069240 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc5946aa-3027-4bf6-8829-e136fd0b7358 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c14e098-e9e4-42e6-960a-3ff0aca15760,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:32.073123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fc5946aa-3027-4bf6-8829-e136fd0b7358 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:32.074042 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fc5946aa-3027-4bf6-8829-e136fd0b7358 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:32.075309 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-fc5946aa-3027-4bf6-8829-e136fd0b7358 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5c14e098-e9e4-42e6-960a-3ff0aca15760 HTTP/1.1" status: 204 len: 168 time: 0.6974618 Feb 17 18:07:32.083705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Pushing event updated for resources: {'Port': ['ID=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89,revision_number=2']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:32.092339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:32.298368 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497750eb-3ccc-4edf-8dc3-65217b14de1b req-d2df7c17-0282-49d9-8fd4-4cea89cd5f0e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:32.306215 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497750eb-3ccc-4edf-8dc3-65217b14de1b req-d2df7c17-0282-49d9-8fd4-4cea89cd5f0e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.1195595 Feb 17 18:07:32.376659 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497750eb-3ccc-4edf-8dc3-65217b14de1b req-286d206f-be3e-427f-a4dd-f830290aca5c tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0692947 Feb 17 18:07:32.431605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f229d378-18a4-4ca4-bbc1-31e55f02bc1e req-491c788c-740a-47f6-a085-4af3be9f9f8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:32.433290 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f229d378-18a4-4ca4-bbc1-31e55f02bc1e req-491c788c-740a-47f6-a085-4af3be9f9f8a service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 1162 time: 0.2556527 Feb 17 18:07:32.498611 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Attempting to bind port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:07:32.498963 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Attempting to bind port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 by drivers openvswitch on host hv-cinder-76019 at level 0 using segments [{'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:07:32.499340 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Attempting to bind port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 on network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:07:32.508531 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f229d378-18a4-4ca4-bbc1-31e55f02bc1e req-de275ff4-a426-4e97-9d13-98a780164169 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659378 Feb 17 18:07:32.509508 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Checking agent: {'id': '35b9bf9c-0314-48b9-bb29-ba3a04c8b13c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 18, 4, 47), 'started_at': datetime.datetime(2021, 2, 17, 18, 5, 17), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 7, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.34', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:07:32.512170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Checking segment: {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'} for mappings: {} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:07:32.512170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:32.512170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Bound using segment: {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:07:32.512170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Bound port: e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89, host: hv-cinder-76019, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'}}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:07:32.512170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:32.615642 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device bb98aa49-1c81-4cea-99cf-f201d19cfdae up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:32.622867 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] For port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89, host hv-cinder-76019, cleared binding levels {{(pid=84112) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:07:32.627274 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] For port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89,segment=NetworkSegment(a3b9a246-e8d6-47cc-bbb0-e0531b20a903),segment_id=a3b9a246-e8d6-47cc-bbb0-e0531b20a903)] {{(pid=84112) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:07:32.685455 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:32.703179 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:32.763631 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port bb98aa49-1c81-4cea-99cf-f201d19cfdae triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:32.764277 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:32.937583 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:32.988761 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Pushing event updated for resources: {'Port': ['ID=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89,revision_number=3']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:33.000942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.294s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:33.007126 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:33.007523 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:33.009721 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] 10.222.0.70 "PUT /v2.0/ports/e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 HTTP/1.1" status: 200 len: 1157 time: 2.3088458 Feb 17 18:07:33.010245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'tag': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:33.027958 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port c3de3799-da31-433f-9203-bfbce68f8d59 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:33.028394 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:33.072992 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'tag': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89', 'status': 'completed', 'code': 200} Feb 17 18:07:33.275939 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcb723f0-aa24-4a2f-ad27-f9e4ddccdc33 req-a0cf54bb-8af7-4cf6-b1bb-149172fb5716 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:33.280357 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fcb723f0-aa24-4a2f-ad27-f9e4ddccdc33 req-a0cf54bb-8af7-4cf6-b1bb-149172fb5716 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 1160 time: 0.1752203 Feb 17 18:07:33.293684 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 54436) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:33.401128 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a6464d-dafd-4b2c-94ff-8e40227096e2 req-d8e455c4-5bdc-48d3-a39d-b176ddb70f1a tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:33.403931 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-73a6464d-dafd-4b2c-94ff-8e40227096e2 req-d8e455c4-5bdc-48d3-a39d-b176ddb70f1a tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1422317 Feb 17 18:07:33.509843 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-73a6464d-dafd-4b2c-94ff-8e40227096e2 req-e0c810b1-1a24-422b-a311-bceac749053d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0917423 Feb 17 18:07:33.595414 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcb723f0-aa24-4a2f-ad27-f9e4ddccdc33 req-78c324f6-d1e0-47a3-bb95-293cb8d9546f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:33.597405 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fcb723f0-aa24-4a2f-ad27-f9e4ddccdc33 req-78c324f6-d1e0-47a3-bb95-293cb8d9546f service neutron] 10.222.0.70 "GET /v2.0/networks?tenant_id=bd48a3996f1246f1ab69d3866874af0b&shared=False HTTP/1.1" status: 200 len: 907 time: 0.3064964 Feb 17 18:07:33.600694 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-880ac14c-a185-4a1b-91a3-1a14212854c0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:33.620818 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-880ac14c-a185-4a1b-91a3-1a14212854c0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:33.700722 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888f97f7-5a1d-4f0a-9a99-1cbfc13cf651 req-51cc3de7-7ffc-4925-9b98-ca677c2ec12d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:33.715961 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-888f97f7-5a1d-4f0a-9a99-1cbfc13cf651 req-51cc3de7-7ffc-4925-9b98-ca677c2ec12d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.1602721 Feb 17 18:07:33.723117 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-880ac14c-a185-4a1b-91a3-1a14212854c0 admin admin] Usage tracker for resource:security_group_rule and tenant:d8fa5d28f2454f788e85ba33855c1446 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:33.733426 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-880ac14c-a185-4a1b-91a3-1a14212854c0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:33.753117 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-880ac14c-a185-4a1b-91a3-1a14212854c0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:33.833303 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-888f97f7-5a1d-4f0a-9a99-1cbfc13cf651 req-506e93d8-0dc0-4929-a43c-6d0f4fccaf01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1201086 Feb 17 18:07:33.895568 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcb723f0-aa24-4a2f-ad27-f9e4ddccdc33 req-45237b41-a737-4059-bc7d-6b96750e0b5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:33.897618 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fcb723f0-aa24-4a2f-ad27-f9e4ddccdc33 req-45237b41-a737-4059-bc7d-6b96750e0b5b service neutron] 10.222.0.70 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 863 time: 0.2731094 Feb 17 18:07:34.063705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-880ac14c-a185-4a1b-91a3-1a14212854c0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:34.087753 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-5c7c9746-bb73-435f-af47-24bb9deba30f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:34.089720 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-5c7c9746-bb73-435f-af47-24bb9deba30f service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 1160 time: 0.1274805 Feb 17 18:07:34.383184 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-880ac14c-a185-4a1b-91a3-1a14212854c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:34.385211 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-afcf5d70-dc4e-4ef7-9202-b6f7bac65a57 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 HTTP/1.1" status: 200 len: 217 time: 0.2861280 Feb 17 18:07:34.393728 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a4815389-1e13-45e9-81dc-2039c73db9e6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:34.497091 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-880ac14c-a185-4a1b-91a3-1a14212854c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=03d994d7-9be8-4b1c-8637-db228615fbef,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:34.506507 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-880ac14c-a185-4a1b-91a3-1a14212854c0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d8fa5d28f2454f788e85ba33855c1446&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2172408 Feb 17 18:07:34.509519 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-880ac14c-a185-4a1b-91a3-1a14212854c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:34.509519 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 54494) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:34.511684 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-4af956c5-5151-40df-9947-d55c45937e90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:34.513264 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-4af956c5-5151-40df-9947-d55c45937e90 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2f43211a-7773-487d-8b86-a136c7f7c156 HTTP/1.1" status: 200 len: 852 time: 0.1206050 Feb 17 18:07:34.641315 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0ebf1c6b-bab5-46c5-ae01-41c9df9ed9ec admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:34.678761 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0ebf1c6b-bab5-46c5-ae01-41c9df9ed9ec admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:34.698707 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device bb98aa49-1c81-4cea-99cf-f201d19cfdae up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:34.708495 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2ec6fa20-c83c-487c-bc55-681143097622 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:34.710134 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-2ec6fa20-c83c-487c-bc55-681143097622 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1782539 Feb 17 18:07:34.808014 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port bb98aa49-1c81-4cea-99cf-f201d19cfdae triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:34.808703 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:34.810417 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1268086e-8674-4f46-829f-48eec4ac7b75 req-48b4b442-84f5-4355-b39d-6934cd275f75 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:34.812119 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1268086e-8674-4f46-829f-48eec4ac7b75 req-48b4b442-84f5-4355-b39d-6934cd275f75 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1202221 Feb 17 18:07:34.869862 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1268086e-8674-4f46-829f-48eec4ac7b75 req-f1127539-200d-47c9-a324-9a9ef03a38f1 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491679 Feb 17 18:07:34.886356 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-5da626ee-32d9-40bb-a958-7c8a16d9c30e service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1629941 Feb 17 18:07:34.889640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0ebf1c6b-bab5-46c5-ae01-41c9df9ed9ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:34.911906 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9180cd68-64cb-4901-a252-b0fa4ae558e3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:35.023508 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ebf1c6b-bab5-46c5-ae01-41c9df9ed9ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03d994d7-9be8-4b1c-8637-db228615fbef,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:35.038616 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0ebf1c6b-bab5-46c5-ae01-41c9df9ed9ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:35.051977 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0ebf1c6b-bab5-46c5-ae01-41c9df9ed9ec admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:35.055796 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-0ebf1c6b-bab5-46c5-ae01-41c9df9ed9ec admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/03d994d7-9be8-4b1c-8637-db228615fbef HTTP/1.1" status: 204 len: 168 time: 0.5442393 Feb 17 18:07:35.109954 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-821b732f-6ff9-4da7-a2ee-a1380f4ea0d9 req-0184ee0c-714d-40df-b0f3-a8f6787bfadf service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2130873 Feb 17 18:07:35.162704 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 54522) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:35.297956 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc2426a6-3fcb-4c0f-98fd-727b60d25d7b req-b8f41255-8dc4-4838-b99d-35823addccfc tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:35.299674 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bc2426a6-3fcb-4c0f-98fd-727b60d25d7b req-b8f41255-8dc4-4838-b99d-35823addccfc tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.1650388 Feb 17 18:07:35.353795 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bc2426a6-3fcb-4c0f-98fd-727b60d25d7b req-1ae92d30-f540-47d4-8455-62c1f7a30898 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468583 Feb 17 18:07:35.402072 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9c2e2d79-0af5-421f-a914-5811e2522440 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:35.434508 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-9c2e2d79-0af5-421f-a914-5811e2522440 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:35.439268 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-9c2e2d79-0af5-421f-a914-5811e2522440 admin admin] Usage tracker for resource:security_group_rule and tenant:043744f6f8534fbda7cbd8605da2b5ef is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:35.442676 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-9c2e2d79-0af5-421f-a914-5811e2522440 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:35.449142 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-9c2e2d79-0af5-421f-a914-5811e2522440 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:35.566810 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9c2e2d79-0af5-421f-a914-5811e2522440 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:35.619212 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9c2e2d79-0af5-421f-a914-5811e2522440 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:35.633530 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:35.699663 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd27b777-12be-4f5f-8402-f3195ff19ed4 req-f16fade7-bf40-4427-be37-88aa19afc8b2 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:35.704294 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-9c2e2d79-0af5-421f-a914-5811e2522440 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=043744f6f8534fbda7cbd8605da2b5ef&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5360072 Feb 17 18:07:35.704410 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cd27b777-12be-4f5f-8402-f3195ff19ed4 req-f16fade7-bf40-4427-be37-88aa19afc8b2 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1471345 Feb 17 18:07:35.704532 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c2e2d79-0af5-421f-a914-5811e2522440 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0940ba1-c0d1-48c5-84f0-7f9a18a40a14,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:35.704632 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54544) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:35.706717 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9c2e2d79-0af5-421f-a914-5811e2522440 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:35.719671 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29aa9d1f-88d3-401a-9149-91bf8548bd66 req-926678e2-0dbd-4a36-8069-a40e5237d55e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:35.721480 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-29aa9d1f-88d3-401a-9149-91bf8548bd66 req-926678e2-0dbd-4a36-8069-a40e5237d55e service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 1162 time: 0.1519849 Feb 17 18:07:35.812317 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cd27b777-12be-4f5f-8402-f3195ff19ed4 req-ed7f290a-49ea-4f33-ab4c-73bfe8f7b69e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0934446 Feb 17 18:07:35.857936 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-afded8d7-1b68-44a0-8c7d-a8e574d7933c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:35.890164 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-afded8d7-1b68-44a0-8c7d-a8e574d7933c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:35.971017 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-afded8d7-1b68-44a0-8c7d-a8e574d7933c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:35.973547 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29aa9d1f-88d3-401a-9149-91bf8548bd66 req-4d76a771-7d59-44ef-b79c-bf3397b73e6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:35.976406 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-29aa9d1f-88d3-401a-9149-91bf8548bd66 req-4d76a771-7d59-44ef-b79c-bf3397b73e6a service neutron] 10.222.0.70 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 913 time: 0.2249298 Feb 17 18:07:35.978525 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-304edf8e-edcf-4656-875c-906813d459a8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:35.992358 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afded8d7-1b68-44a0-8c7d-a8e574d7933c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0940ba1-c0d1-48c5-84f0-7f9a18a40a14,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:35.997525 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-afded8d7-1b68-44a0-8c7d-a8e574d7933c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:36.018293 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-afded8d7-1b68-44a0-8c7d-a8e574d7933c admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:36.019553 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-afded8d7-1b68-44a0-8c7d-a8e574d7933c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c0940ba1-c0d1-48c5-84f0-7f9a18a40a14 HTTP/1.1" status: 204 len: 168 time: 0.3152125 Feb 17 18:07:36.061608 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-29aa9d1f-88d3-401a-9149-91bf8548bd66 req-c1faa0d7-d1c6-4e3d-8b29-baf4b2721d5a service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=bb98aa49-1c81-4cea-99cf-f201d19cfdae HTTP/1.1" status: 200 len: 217 time: 0.0777256 Feb 17 18:07:36.098256 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54560) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:36.150329 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29aa9d1f-88d3-401a-9149-91bf8548bd66 req-03f63b5c-4b44-41de-ae9c-022d0dcf1f0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:36.152468 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-29aa9d1f-88d3-401a-9149-91bf8548bd66 req-03f63b5c-4b44-41de-ae9c-022d0dcf1f0f service neutron] 10.222.0.70 "GET /v2.0/subnets?id=c04f01da-1295-4b8a-95ae-46589cb07040 HTTP/1.1" status: 200 len: 859 time: 0.0786240 Feb 17 18:07:36.208288 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-29aa9d1f-88d3-401a-9149-91bf8548bd66 req-03879a02-ef18-4c01-bf63-2b82b6575db2 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4aaf4a03-4480-421f-bff4-f9814e969001&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0483162 Feb 17 18:07:36.277509 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-38ff634d-fbfd-4356-9492-c97da9faf5a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:36.298968 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-38ff634d-fbfd-4356-9492-c97da9faf5a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:36.308096 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-38ff634d-fbfd-4356-9492-c97da9faf5a7 admin admin] Usage tracker for resource:security_group_rule and tenant:25e6a65303d84f0bb030276bdf5d05ea is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:36.322318 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-38ff634d-fbfd-4356-9492-c97da9faf5a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:36.329105 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-38ff634d-fbfd-4356-9492-c97da9faf5a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:36.382518 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-29aa9d1f-88d3-401a-9149-91bf8548bd66 req-3d597c4e-d414-43fa-893d-9b4fb4c7a9a9 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1579120 Feb 17 18:07:36.441498 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-38ff634d-fbfd-4356-9492-c97da9faf5a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:36.489859 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-38ff634d-fbfd-4356-9492-c97da9faf5a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:36.501433 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fc5946aa-3027-4bf6-8829-e136fd0b7358 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:36.573270 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-29aa9d1f-88d3-401a-9149-91bf8548bd66 req-69febc2e-56be-4ab2-ab82-dd677084110a service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1842287 Feb 17 18:07:36.593993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38ff634d-fbfd-4356-9492-c97da9faf5a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3523d199-74aa-4249-88bf-4218e15f3a40,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:36.646419 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-38ff634d-fbfd-4356-9492-c97da9faf5a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:36.686805 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 54586) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:36.700906 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-38ff634d-fbfd-4356-9492-c97da9faf5a7 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=25e6a65303d84f0bb030276bdf5d05ea&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6016870 Feb 17 18:07:36.750628 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676fa40f-97f6-4832-8662-92acbf97420f req-825ab218-3e89-44a4-810a-040b9ac35ced tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:36.758896 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-676fa40f-97f6-4832-8662-92acbf97420f req-825ab218-3e89-44a4-810a-040b9ac35ced tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.2009516 Feb 17 18:07:36.777791 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e3955382-4110-4618-9ae5-6cabc65c8b8d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:36.821614 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-676fa40f-97f6-4832-8662-92acbf97420f req-7c0437a3-5beb-4272-a504-2c07550cb274 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0613642 Feb 17 18:07:36.855359 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e3955382-4110-4618-9ae5-6cabc65c8b8d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:36.970211 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e3955382-4110-4618-9ae5-6cabc65c8b8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:36.975769 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9c2e2d79-0af5-421f-a914-5811e2522440 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:36.994958 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3955382-4110-4618-9ae5-6cabc65c8b8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3523d199-74aa-4249-88bf-4218e15f3a40,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:36.998114 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e3955382-4110-4618-9ae5-6cabc65c8b8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:37.023680 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e3955382-4110-4618-9ae5-6cabc65c8b8d admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:37.025525 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e3955382-4110-4618-9ae5-6cabc65c8b8d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3523d199-74aa-4249-88bf-4218e15f3a40 HTTP/1.1" status: 204 len: 168 time: 0.3375700 Feb 17 18:07:37.053225 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 54606) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:37.057325 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a68f8a-b11b-465e-89d2-8b05b060adb1 req-f74eff04-f790-4756-9e3a-6e886710f675 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:37.059043 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-55a68f8a-b11b-465e-89d2-8b05b060adb1 req-f74eff04-f790-4756-9e3a-6e886710f675 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1215506 Feb 17 18:07:37.085071 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-561a7d20-9e3a-434c-ad89-6e2997770a51 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:37.104831 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-561a7d20-9e3a-434c-ad89-6e2997770a51 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:37.109445 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-561a7d20-9e3a-434c-ad89-6e2997770a51 admin admin] Usage tracker for resource:security_group_rule and tenant:561067a88ead46b68acd75e3cec69fc6 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:37.112925 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-561a7d20-9e3a-434c-ad89-6e2997770a51 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:37.120439 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-561a7d20-9e3a-434c-ad89-6e2997770a51 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:37.178074 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-55a68f8a-b11b-465e-89d2-8b05b060adb1 req-f0f4f094-b93d-49cc-9337-a880dcab855b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1086318 Feb 17 18:07:37.220563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7782245-bc5e-47fa-b14a-24e2958d1412 req-53c3bf05-5547-405e-9095-a154156cc22d tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:37.222405 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b7782245-bc5e-47fa-b14a-24e2958d1412 req-53c3bf05-5547-405e-9095-a154156cc22d tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 945 time: 0.1267984 Feb 17 18:07:37.236009 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-561a7d20-9e3a-434c-ad89-6e2997770a51 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:37.272535 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-561a7d20-9e3a-434c-ad89-6e2997770a51 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:37.287584 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:37.293399 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b7782245-bc5e-47fa-b14a-24e2958d1412 req-14877707-4c49-453a-b9e0-d5cc1d3cd6a3 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571716 Feb 17 18:07:37.340124 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-561a7d20-9e3a-434c-ad89-6e2997770a51 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=561067a88ead46b68acd75e3cec69fc6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2856095 Feb 17 18:07:37.342591 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-561a7d20-9e3a-434c-ad89-6e2997770a51 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d28ff47b-ad59-498c-bef6-dc320f66a48f,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:37.343330 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54614) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:37.347122 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-561a7d20-9e3a-434c-ad89-6e2997770a51 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:37.422443 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-264b5136-17a7-4334-8a45-503d9eeb2340 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:37.454588 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-264b5136-17a7-4334-8a45-503d9eeb2340 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:37.563956 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-264b5136-17a7-4334-8a45-503d9eeb2340 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:37.569204 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9ec65038-058a-4649-af29-6e971835e32e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:37.601560 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-264b5136-17a7-4334-8a45-503d9eeb2340 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d28ff47b-ad59-498c-bef6-dc320f66a48f,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:37.610744 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-264b5136-17a7-4334-8a45-503d9eeb2340 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:37.639398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-264b5136-17a7-4334-8a45-503d9eeb2340 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:37.643056 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-264b5136-17a7-4334-8a45-503d9eeb2340 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d28ff47b-ad59-498c-bef6-dc320f66a48f HTTP/1.1" status: 204 len: 168 time: 0.2957397 Feb 17 18:07:37.695822 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a081147c-1978-4bea-8f4d-7bdb528da8bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:37.878001 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54640) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:37.904801 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-228de6a7-a541-44e0-a0e2-ccfdeaa17f2c admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:37.925446 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-228de6a7-a541-44e0-a0e2-ccfdeaa17f2c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:37.929779 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-228de6a7-a541-44e0-a0e2-ccfdeaa17f2c admin admin] Usage tracker for resource:security_group_rule and tenant:7f4d90106c354dbbbe4617a6643178aa is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:37.933523 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-228de6a7-a541-44e0-a0e2-ccfdeaa17f2c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:37.941975 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-228de6a7-a541-44e0-a0e2-ccfdeaa17f2c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:38.142572 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfe88293-973d-4a4b-b21e-04ef9de904fa req-4f1b4b77-4246-47c8-90f1-c231d758a586 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:38.144198 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cfe88293-973d-4a4b-b21e-04ef9de904fa req-4f1b4b77-4246-47c8-90f1-c231d758a586 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.1576285 Feb 17 18:07:38.149146 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-228de6a7-a541-44e0-a0e2-ccfdeaa17f2c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:38.189867 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-228de6a7-a541-44e0-a0e2-ccfdeaa17f2c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:38.200826 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-aa17760c-f991-4a4b-8554-790357607379 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:38.216769 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cfe88293-973d-4a4b-b21e-04ef9de904fa req-18fb1f53-6fcd-4c6c-be86-23c0bb2b2af8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0647027 Feb 17 18:07:38.253631 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-228de6a7-a541-44e0-a0e2-ccfdeaa17f2c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=7f4d90106c354dbbbe4617a6643178aa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3725655 Feb 17 18:07:38.254082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54662) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:38.256577 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-228de6a7-a541-44e0-a0e2-ccfdeaa17f2c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97497f0f-c923-4481-ba3a-e533d1fd93d9,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:38.302224 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-228de6a7-a541-44e0-a0e2-ccfdeaa17f2c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:38.327051 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fe0afacd-ab24-4362-b01b-17be25fbe108 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:38.359061 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fe0afacd-ab24-4362-b01b-17be25fbe108 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:38.474600 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fe0afacd-ab24-4362-b01b-17be25fbe108 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:38.486606 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c75f4d73-d1a5-40db-96d1-3daf0f50684a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:38.564097 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe0afacd-ab24-4362-b01b-17be25fbe108 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97497f0f-c923-4481-ba3a-e533d1fd93d9,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:38.581846 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fe0afacd-ab24-4362-b01b-17be25fbe108 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:38.604742 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fe0afacd-ab24-4362-b01b-17be25fbe108 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:38.605926 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-fe0afacd-ab24-4362-b01b-17be25fbe108 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/97497f0f-c923-4481-ba3a-e533d1fd93d9 HTTP/1.1" status: 204 len: 168 time: 0.3511643 Feb 17 18:07:38.641405 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad06c7c-244b-411a-b088-0a9e3362f4b3 req-8f7db3a0-34dc-4429-8047-35c384aed93a tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:38.643026 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bad06c7c-244b-411a-b088-0a9e3362f4b3 req-8f7db3a0-34dc-4429-8047-35c384aed93a tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 945 time: 0.1698914 Feb 17 18:07:38.654236 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4d4d6d0-6d40-4057-89d7-0682fbfa91e6 req-c17e732a-efe5-4e15-b003-d5eb7ba78cb6 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:38.655842 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c4d4d6d0-6d40-4057-89d7-0682fbfa91e6 req-c17e732a-efe5-4e15-b003-d5eb7ba78cb6 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.2284636 Feb 17 18:07:38.732033 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bad06c7c-244b-411a-b088-0a9e3362f4b3 req-a4ac16a3-2baa-4007-b5d0-e7c05d7011e8 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728765 Feb 17 18:07:38.763425 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c4d4d6d0-6d40-4057-89d7-0682fbfa91e6 req-8293a002-43a9-4d74-a149-bbe583eb332f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0840850 Feb 17 18:07:39.233661 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ecaa5f3-a93c-4e13-b127-7afa9941ceb6 req-1d094ac0-c1ed-4167-8862-dae8d87a337d tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:39.233661 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7ecaa5f3-a93c-4e13-b127-7afa9941ceb6 req-1d094ac0-c1ed-4167-8862-dae8d87a337d tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.70 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 945 time: 0.1337836 Feb 17 18:07:39.290511 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:39.318743 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-7ecaa5f3-a93c-4e13-b127-7afa9941ceb6 req-e365d3b0-30d7-47a6-b71d-1b383fa16d4b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Deleting port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a {{(pid=84112) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:07:39.319442 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-7ecaa5f3-a93c-4e13-b127-7afa9941ceb6 req-e365d3b0-30d7-47a6-b71d-1b383fa16d4b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:39.381143 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54706) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:39.417621 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6bf88774-93f4-4cec-87bd-f4151dcede1b admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:39.436048 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-6bf88774-93f4-4cec-87bd-f4151dcede1b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:39.442352 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-6bf88774-93f4-4cec-87bd-f4151dcede1b admin admin] Usage tracker for resource:security_group_rule and tenant:f5b81750c3464ecba07cc4e636e28f4b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:39.479285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning for port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:07:39.491210 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:39.491210 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:39.522825 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-6bf88774-93f4-4cec-87bd-f4151dcede1b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:39.537650 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-6bf88774-93f4-4cec-87bd-f4151dcede1b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:39.588531 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54710) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:39.653695 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a5391e7-f1ee-4825-bf27-23b2fe68a4f1 req-e84f2736-6634-402b-b5fa-a008b2885e3b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:39.656429 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9a5391e7-f1ee-4825-bf27-23b2fe68a4f1 req-e84f2736-6634-402b-b5fa-a008b2885e3b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.2156358 Feb 17 18:07:39.681943 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:39.699755 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-7ecaa5f3-a93c-4e13-b127-7afa9941ceb6 req-e365d3b0-30d7-47a6-b71d-1b383fa16d4b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] For port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a,segment=NetworkSegment(c2d54292-0536-4a70-b118-0e7d52b9d0a7),segment_id=c2d54292-0536-4a70-b118-0e7d52b9d0a7)] {{(pid=84112) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:07:39.700409 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-7ecaa5f3-a93c-4e13-b127-7afa9941ceb6 req-e365d3b0-30d7-47a6-b71d-1b383fa16d4b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:39.720421 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89,segment=NetworkSegment(a3b9a246-e8d6-47cc-bbb0-e0531b20a903),segment_id=a3b9a246-e8d6-47cc-bbb0-e0531b20a903)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:07:39.721486 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:39.757992 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:39.760082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9c63ea37-b974-4ebe-9488-af3a174517f7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:39.796048 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9a5391e7-f1ee-4825-bf27-23b2fe68a4f1 req-bce14377-97f3-4bc0-95b6-28de3b2485ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1315098 Feb 17 18:07:39.835965 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6bf88774-93f4-4cec-87bd-f4151dcede1b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:39.845833 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1630825136-network', 'tenant_id': 'cff1e61c03254c2f845d1aaf38f39663'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:39.851436 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:39.856913 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Usage tracker for resource:network and tenant:cff1e61c03254c2f845d1aaf38f39663 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:39.860123 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:39.866251 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:39.870171 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89', 'code': 200} Feb 17 18:07:39.883800 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6bf88774-93f4-4cec-87bd-f4151dcede1b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:39.907176 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-7ecaa5f3-a93c-4e13-b127-7afa9941ceb6 req-e365d3b0-30d7-47a6-b71d-1b383fa16d4b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Calling delete_port for 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a owned by compute:nova {{(pid=84112) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:07:39.931009 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0c4153d5-ebc2-4eef-8753-09d55c4c037f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:39.960108 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-6bf88774-93f4-4cec-87bd-f4151dcede1b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f5b81750c3464ecba07cc4e636e28f4b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5776789 Feb 17 18:07:39.961197 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Made reservation on behalf of cff1e61c03254c2f845d1aaf38f39663 for: {'network': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:07:39.963991 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 54724) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:39.967142 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:39.991009 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-436c1cfb-a6dd-462b-8c9f-1eac606dac0c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:39.997522 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:40.007032 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:40.020889 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bf88774-93f4-4cec-87bd-f4151dcede1b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da9240cf-19c4-4a44-8b28-b6a3f443d20f,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:40.026317 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.090057 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6bf88774-93f4-4cec-87bd-f4151dcede1b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:40.094244 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:40.098357 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Usage tracker for resource:security_group_rule and tenant:cff1e61c03254c2f845d1aaf38f39663 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:40.101352 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:40.107316 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:40.240308 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ecfbd03-1cff-4d85-8d58-4cc1880fb99a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.269868 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ecfbd03-1cff-4d85-8d58-4cc1880fb99a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.271610 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30aae9e7-170f-453b-8f2b-2fc236bcc856 req-e7494b62-cc1e-4a02-9799-5a862804c0f8 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:40.273363 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-30aae9e7-170f-453b-8f2b-2fc236bcc856 req-e7494b62-cc1e-4a02-9799-5a862804c0f8 tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 945 time: 0.2301557 Feb 17 18:07:40.279622 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a250f3f8-5063-4525-9b40-d1d0eef955f7 req-d617b04b-7df2-4a00-a981-7cdba37ea352 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:40.281209 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a250f3f8-5063-4525-9b40-d1d0eef955f7 req-d617b04b-7df2-4a00-a981-7cdba37ea352 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.2992296 Feb 17 18:07:40.312117 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.356517 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-30aae9e7-170f-453b-8f2b-2fc236bcc856 req-950c67e0-1f65-4a6f-9b59-588cea91364d tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/security-groups?id=17e0eced-062a-4742-8379-f04c949c37d1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0687499 Feb 17 18:07:40.375321 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.389478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-471bd1ed-84c2-4951-89fb-3ffabd2487ed admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:40.392413 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ecfbd03-1cff-4d85-8d58-4cc1880fb99a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.404926 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-561a7d20-9e3a-434c-ad89-6e2997770a51 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:40.424142 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=657effe1-5114-4024-831b-cb01b39f4720,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:40.428811 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ecfbd03-1cff-4d85-8d58-4cc1880fb99a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da9240cf-19c4-4a44-8b28-b6a3f443d20f,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:40.434253 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3ecfbd03-1cff-4d85-8d58-4cc1880fb99a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:40.436905 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17fddfed-3e7b-4d81-8680-2a01071a2263 req-66e18daa-c5c4-4a8e-8bfa-9e6d911d136c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:40.437510 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:40.438858 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-17fddfed-3e7b-4d81-8680-2a01071a2263 req-66e18daa-c5c4-4a8e-8bfa-9e6d911d136c service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 1162 time: 0.2671208 Feb 17 18:07:40.440839 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a250f3f8-5063-4525-9b40-d1d0eef955f7 req-f3bcd43d-49a5-4f87-88e4-341f23d3f744 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1206245 Feb 17 18:07:40.483275 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-7ecaa5f3-a93c-4e13-b127-7afa9941ceb6 req-e365d3b0-30d7-47a6-b71d-1b383fa16d4b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.513372 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-2e174d63-47dc-4554-a214-72b58fb40ce6 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:40.518089 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] vxlan segment allocate from pool success with {'vxlan_vni': 6} {{(pid=84111) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:151}} Feb 17 18:07:40.528924 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.532641 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Added segment 29e59226-6ca4-4d8a-8500-0fad2002cbfe of type vxlan for network 97759fc8-b7a8-4b8f-a577-a9edf94b1cc2 Feb 17 18:07:40.568281 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.627587 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:40.638145 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3ecfbd03-1cff-4d85-8d58-4cc1880fb99a admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.642228 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3ecfbd03-1cff-4d85-8d58-4cc1880fb99a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/da9240cf-19c4-4a44-8b28-b6a3f443d20f HTTP/1.1" status: 204 len: 168 time: 0.6768932 Feb 17 18:07:40.643453 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e365d3b0-30d7-47a6-b71d-1b383fa16d4b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Pushing event deleted for resources: {'Port': ['ID=703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:40.656021 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e365d3b0-30d7-47a6-b71d-1b383fa16d4b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:40.662964 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-17fddfed-3e7b-4d81-8680-2a01071a2263 req-896c0ecd-ce76-45e5-9eb6-3ce4366baaba service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2045810 Feb 17 18:07:40.721978 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:40.722406 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.729560 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.730850 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:40.731481 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.736838 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-cd7b5178-6c3a-4c55-8201-62a683c54b72 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:40.786857 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-7ecaa5f3-a93c-4e13-b127-7afa9941ceb6 req-e365d3b0-30d7-47a6-b71d-1b383fa16d4b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] No DVR routers for this DVR port 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a on host hv-cinder-76019 {{(pid=84112) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Feb 17 18:07:40.790963 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-7ecaa5f3-a93c-4e13-b127-7afa9941ceb6 req-e365d3b0-30d7-47a6-b71d-1b383fa16d4b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.793524 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7ecaa5f3-a93c-4e13-b127-7afa9941ceb6 req-e365d3b0-30d7-47a6-b71d-1b383fa16d4b tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.70 "DELETE /v2.0/ports/703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a HTTP/1.1" status: 204 len: 173 time: 1.5557902 Feb 17 18:07:40.794062 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0acf3623-ba41-4c0a-9078-ebe03ab82af3', 'name': 'network-vif-deleted', 'tag': '703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:40.849826 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:40.866639 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0acf3623-ba41-4c0a-9078-ebe03ab82af3', 'name': 'network-vif-deleted', 'tag': '703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a', 'status': 'completed', 'code': 200} Feb 17 18:07:40.907163 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Pushing event updated for resources: {'Network': ['ID=97759fc8-b7a8-4b8f-a577-a9edf94b1cc2,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:40.918198 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:40.947607 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 875 time: 1.3520935 Feb 17 18:07:40.950687 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 54752) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:40.957715 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Request body: {'subnet': {'network_id': '97759fc8-b7a8-4b8f-a577-a9edf94b1cc2', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1630825136-subnet', 'tenant_id': 'cff1e61c03254c2f845d1aaf38f39663', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:40.963961 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:40.976208 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Usage tracker for resource:subnet and tenant:cff1e61c03254c2f845d1aaf38f39663 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:40.987853 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:40.999106 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:41.036924 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Network 97759fc8-b7a8-4b8f-a577-a9edf94b1cc2 details requested by agent ovs-agent-hv-cinder-76019 with host hv-cinder-76019 {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:07:41.049968 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network 97759fc8-b7a8-4b8f-a577-a9edf94b1cc2 details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:07:41.055183 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Made reservation on behalf of cff1e61c03254c2f845d1aaf38f39663 for: {'subnet': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:07:41.061345 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3924474'] for subnet, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:41.132354 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a6149b-895a-4f03-9de8-31c20c625827 req-1fca79b7-e17c-4498-b05b-1eadb27d6784 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:41.134218 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-08a6149b-895a-4f03-9de8-31c20c625827 req-1fca79b7-e17c-4498-b05b-1eadb27d6784 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1545699 Feb 17 18:07:41.224088 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-08a6149b-895a-4f03-9de8-31c20c625827 req-ce9a857a-95cf-4ffc-98b3-dac42d18db11 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0815799 Feb 17 18:07:41.231795 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a no longer exists at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:07:41.289078 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] No Port match for: 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:07:41.289550 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 703cd67e-7ff7-4dda-aafe-7e8c34bfdc5a not bound to the agent host hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:07:41.547177 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-71803a34-ee15-4648-bfd2-563d106d8dc4 req-c383c3de-b522-4fdb-a9c6-3bf8e7b840ed tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 210 time: 0.0515034 Feb 17 18:07:41.689717 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715ce8fa-a55c-4ae0-bef5-dfe3e33ee044 req-d61101b3-f9b0-4842-a631-d0691255dc28 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:41.692693 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-715ce8fa-a55c-4ae0-bef5-dfe3e33ee044 req-d61101b3-f9b0-4842-a631-d0691255dc28 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1269693 Feb 17 18:07:41.748395 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-715ce8fa-a55c-4ae0-bef5-dfe3e33ee044 req-47835e5f-56c0-42ad-ab83-63ccde2c6daa tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504472 Feb 17 18:07:41.950644 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2235764', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3924459'] for subnet, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:41.953201 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-86d26ba3-b798-494c-9f1f-777cea4cbe76 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:42.032822 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:42.172585 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7b0b79d1-a638-448b-805c-5f1c37b05f9c,revision_number=0']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:42.180658 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:42.233080 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2b1a2728-c4a0-4ccc-91dc-f94fd3415cbb req-92482220-b1f6-4c45-a077-d6e293a76958 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 272 time: 0.1553681 Feb 17 18:07:42.265835 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Checking segment: {'id': '29e59226-6ca4-4d8a-8500-0fad2002cbfe', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '97759fc8-b7a8-4b8f-a577-a9edf94b1cc2'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:07:42.266238 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Network hostable DHCP agents. Network: 97759fc8-b7a8-4b8f-a577-a9edf94b1cc2, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84112) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 18:07:42.347116 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Network 97759fc8-b7a8-4b8f-a577-a9edf94b1cc2 is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84112) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 18:07:42.430194 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, 97759fc8-b7a8-4b8f-a577-a9edf94b1cc2) {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:07:42.439302 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ff379f8-15c3-480f-9b72-03b31585bcc1 None None] Network 97759fc8-b7a8-4b8f-a577-a9edf94b1cc2 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:07:42.460384 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:42.461467 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:42.465006 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fec02cf-b3a2-4852-970f-d8c38e2da7c3 req-36f03c0b-068b-49e1-8382-182da3790426 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:42.483947 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7fec02cf-b3a2-4852-970f-d8c38e2da7c3 req-36f03c0b-068b-49e1-8382-182da3790426 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0996349 Feb 17 18:07:42.496884 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1a2728-c4a0-4ccc-91dc-f94fd3415cbb req-492b76c6-4087-49f0-b972-7d9b9a883392 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:42.498774 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2b1a2728-c4a0-4ccc-91dc-f94fd3415cbb req-492b76c6-4087-49f0-b972-7d9b9a883392 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 1163 time: 0.1351018 Feb 17 18:07:42.524458 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7fec02cf-b3a2-4852-970f-d8c38e2da7c3 req-8fc3f8a5-69fe-4b7a-92ec-bb95e8df094a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0492151 Feb 17 18:07:42.730786 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1a2728-c4a0-4ccc-91dc-f94fd3415cbb req-abf28255-0c31-4038-afaa-f8fa6f9f6668 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:42.733029 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2b1a2728-c4a0-4ccc-91dc-f94fd3415cbb req-abf28255-0c31-4038-afaa-f8fa6f9f6668 service neutron] 10.222.0.70 "GET /v2.0/networks?id=ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 200 len: 909 time: 0.1998394 Feb 17 18:07:42.744648 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-ffb1605a-358a-445a-a39c-5bd93fbf8b82 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.7926438 Feb 17 18:07:42.856518 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2b1a2728-c4a0-4ccc-91dc-f94fd3415cbb req-c3d63368-18f3-4b41-a480-e5e81db7dfb8 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 HTTP/1.1" status: 200 len: 217 time: 0.1093364 Feb 17 18:07:42.903814 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:42.964014 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1a2728-c4a0-4ccc-91dc-f94fd3415cbb req-1f207e72-c600-4be7-b063-4d9d11365dc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:42.967040 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2b1a2728-c4a0-4ccc-91dc-f94fd3415cbb req-1f207e72-c600-4be7-b063-4d9d11365dc0 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=e1b65f5a-677d-4368-874f-50623d3454b9 HTTP/1.1" status: 200 len: 855 time: 0.0933175 Feb 17 18:07:43.088550 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ebc482c0-6eab-4899-b4e8-3f65eccc44cd req-4fcd7e65-6a02-4c41-8ae6-8bf1adb329ab tempest-DeleteServersTestJSON-1737843100 tempest-DeleteServersTestJSON-1737843100-project] 10.222.0.13 "GET /v2.0/ports?device_id=0acf3623-ba41-4c0a-9078-ebe03ab82af3 HTTP/1.1" status: 200 len: 210 time: 0.1223516 Feb 17 18:07:43.130822 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2b1a2728-c4a0-4ccc-91dc-f94fd3415cbb req-3dbe1af1-2f5d-4b7e-8cf1-f6530288da88 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=ee1c48e9-8681-4765-bc5b-bc0215d911a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1529379 Feb 17 18:07:43.155808 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99b9ef44-a6fb-4500-8f1d-1a7f13b3abe9 req-12699375-51e8-464c-bd83-9bafce8ecb08 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:43.161998 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-99b9ef44-a6fb-4500-8f1d-1a7f13b3abe9 req-12699375-51e8-464c-bd83-9bafce8ecb08 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.2993069 Feb 17 18:07:43.173150 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 54848) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:43.181165 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-77b03698-5047-48d5-bd57-3a81ad72268a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Request body: {'floatingip': {'port_id': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:43.247757 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:43.252057 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19a751e4-5e82-49ff-8ff1-423f9a0fe8d0 None None] Network 97759fc8-b7a8-4b8f-a577-a9edf94b1cc2 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:07:43.360938 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:43.362139 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:43.535981 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2b1a2728-c4a0-4ccc-91dc-f94fd3415cbb req-86f6d755-3f83-4cac-b191-f8a456e02891 service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3889687 Feb 17 18:07:43.584149 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-77b03698-5047-48d5-bd57-3a81ad72268a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for floatingip, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:43.763448 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2b1a2728-c4a0-4ccc-91dc-f94fd3415cbb req-77405936-262d-4ab7-a41a-3562d072ec80 service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1976883 Feb 17 18:07:43.859644 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-984ae189-cdd9-4b8e-ac52-b440bc6e1f4f req-b497bd05-9036-4974-80fe-8a67cd5eac4c tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:43.864397 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-984ae189-cdd9-4b8e-ac52-b440bc6e1f4f req-b497bd05-9036-4974-80fe-8a67cd5eac4c tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.4810388 Feb 17 18:07:44.207527 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-984ae189-cdd9-4b8e-ac52-b440bc6e1f4f req-62cd1973-3ed3-4bad-b5cb-0ecfb1df9b81 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704772 Feb 17 18:07:44.300974 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 54892) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:44.307650 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-2017823654-network', 'tenant_id': '75271f713312489cbb30f15604711e23'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:44.312704 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:44.317345 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Usage tracker for resource:network and tenant:75271f713312489cbb30f15604711e23 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:44.321725 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:44.329612 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:44.381209 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Made reservation on behalf of 75271f713312489cbb30f15604711e23 for: {'network': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:07:44.387886 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:44.402756 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:44.421031 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:44.426231 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Usage tracker for resource:security_group_rule and tenant:75271f713312489cbb30f15604711e23 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:44.429963 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:44.437275 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:44.538003 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:44.598358 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:44.603640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:44.681305 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] vxlan segment allocate from pool success with {'vxlan_vni': 8} {{(pid=84112) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:151}} Feb 17 18:07:44.689261 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b53e8546-be44-4956-8841-86ed4ffc500f,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:44.698402 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.698811 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.699214 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.699606 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.700147 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.700533 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.700927 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.701310 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.701694 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.705348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.705348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.705348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.705348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.705348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.705348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.705348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.705348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.705348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.706239 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.706239 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.706419 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.706837 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.707085 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.707464 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:44.716599 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:44.716599 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment--9223363306798059772', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:44.716599 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Added segment 32fbfdee-001e-40c9-98e6-c86dfab2a3e8 of type vxlan for network 2866144d-ebea-4fc7-a2ed-9a219704d84f Feb 17 18:07:44.792725 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:44.849804 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:44.851859 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:44.853348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:44.858795 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:44.967037 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Pushing event updated for resources: {'Network': ['ID=2866144d-ebea-4fc7-a2ed-9a219704d84f,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:44.970571 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:44.978069 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-0d1c81f6-5753-4c42-892d-a426436a1132 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:44.979723 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-0d1c81f6-5753-4c42-892d-a426436a1132 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/networks?id=ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 200 len: 815 time: 0.2799714 Feb 17 18:07:44.992036 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network 2866144d-ebea-4fc7-a2ed-9a219704d84f details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:07:45.011358 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 875 time: 0.7091405 Feb 17 18:07:45.014256 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 54932) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:45.021025 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Request body: {'subnet': {'network_id': '2866144d-ebea-4fc7-a2ed-9a219704d84f', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-2017823654-subnet', 'tenant_id': '75271f713312489cbb30f15604711e23', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:45.035643 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:45.044498 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Usage tracker for resource:subnet and tenant:75271f713312489cbb30f15604711e23 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:45.054011 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:45.068878 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:45.090089 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-cb1b94a3-c0fc-4087-a8c3-33aaab7fa22a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/quotas/c2e8792284c348238cf9afdcae0c221e HTTP/1.1" status: 200 len: 375 time: 0.0426009 Feb 17 18:07:45.141107 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Made reservation on behalf of 75271f713312489cbb30f15604711e23 for: {'subnet': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:07:45.144682 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-77b03698-5047-48d5-bd57-3a81ad72268a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for floatingip, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:45.146717 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3924474'] for subnet, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:45.177180 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-77b03698-5047-48d5-bd57-3a81ad72268a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036854376515'] for floatingip, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:45.345346 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-08849c2f-ecb2-4ef0-a7dd-f8507eeb2a44 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2462790 Feb 17 18:07:45.527631 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.l3_db [None req-77b03698-5047-48d5-bd57-3a81ad72268a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Floating IP 08d5d43d-cc01-43c2-86a1-6faa4c214dbe associated. External IP: 172.27.1.57, port: e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89. Feb 17 18:07:45.709842 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2235764', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3924459'] for subnet, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:45.727892 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:45.834557 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a25652d0-de9d-4cf8-97c3-2c842fae4762,revision_number=0']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:45.838099 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:45.937336 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4d07fc9e-514d-423d-a648-aab6d3edd634 service neutron] 10.222.0.13 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5788441 Feb 17 18:07:45.948002 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Checking segment: {'id': '32fbfdee-001e-40c9-98e6-c86dfab2a3e8', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 8, 'network_id': '2866144d-ebea-4fc7-a2ed-9a219704d84f'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:07:45.948476 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Network hostable DHCP agents. Network: 2866144d-ebea-4fc7-a2ed-9a219704d84f, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84112) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 18:07:45.986058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76ac8630-1d1d-477e-920b-3940f7d3a202 req-d59ee38f-8ee4-4371-9cc5-970d76309706 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:45.987643 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-76ac8630-1d1d-477e-920b-3940f7d3a202 req-d59ee38f-8ee4-4371-9cc5-970d76309706 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.6043735 Feb 17 18:07:46.020905 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Network 2866144d-ebea-4fc7-a2ed-9a219704d84f is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84112) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 18:07:46.066423 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, 2866144d-ebea-4fc7-a2ed-9a219704d84f) {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:07:46.076763 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6e5f500-60f2-479c-befa-3af12e6e053d None None] Network 2866144d-ebea-4fc7-a2ed-9a219704d84f requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:07:46.081300 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:46.081595 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:46.130661 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-bcffa46c-81ba-49f3-97a4-022b2043e8c8 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.1148582 Feb 17 18:07:46.250157 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-76ac8630-1d1d-477e-920b-3940f7d3a202 req-672a7c87-3e03-4ca1-83b0-836ee22d76b3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2053809 Feb 17 18:07:46.325907 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-7407b6d2-efbf-416d-a4c2-c002bd6f7b46 service neutron] 10.222.0.13 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.3804195 Feb 17 18:07:46.326603 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31edc955-a1d2-4dbf-b37a-33908224e958 None None] Network 2866144d-ebea-4fc7-a2ed-9a219704d84f requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:07:46.349510 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-77b03698-5047-48d5-bd57-3a81ad72268a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 has already been hosted by L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b {{(pid=84111) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:130}} Feb 17 18:07:46.644991 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0e06bf96-59c2-4fe5-9bf7-c7d80ad2bf6a req-3e8899f2-c889-46ba-b927-c39dee8c3ba5 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 210 time: 0.1090703 Feb 17 18:07:46.650921 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-77b03698-5047-48d5-bd57-3a81ad72268a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84111) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:07:46.655902 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-77b03698-5047-48d5-bd57-3a81ad72268a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for floatingip, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:46.665651 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39142b64-eb9b-4619-a434-8ad9e93d5db6 None None] Sync routers for ids ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'] in dv-cinder-760194-3-iscsi {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:07:46.683600 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39142b64-eb9b-4619-a434-8ad9e93d5db6 None None] Routers {'26ce0b68-6f29-498d-8e7d-e9fdae0ac663'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:07:46.684978 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-39142b64-eb9b-4619-a434-8ad9e93d5db6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:07:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:46.756050 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-77b03698-5047-48d5-bd57-3a81ad72268a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "PUT /v2.0/floatingips/08d5d43d-cc01-43c2-86a1-6faa4c214dbe HTTP/1.1" status: 200 len: 990 time: 3.5815008 Feb 17 18:07:46.756952 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'tag': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:46.809559 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'tag': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89', 'status': 'completed', 'code': 200} Feb 17 18:07:47.078326 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-39142b64-eb9b-4619-a434-8ad9e93d5db6 None None] Set router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:07:47.509086 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340655ab-8a09-410f-b322-e239dbe643cd req-f5a60a19-4660-49b0-9cfb-8071f81af91d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:47.510719 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-340655ab-8a09-410f-b322-e239dbe643cd req-f5a60a19-4660-49b0-9cfb-8071f81af91d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.0901570 Feb 17 18:07:47.512528 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-39142b64-eb9b-4619-a434-8ad9e93d5db6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:07:06Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_floatingips': [{'id': '08d5d43d-cc01-43c2-86a1-6faa4c214dbe', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'floating_ip_address': '172.27.1.57', 'floating_network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'router_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'port_id': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 169, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'mac_address': 'fa:16:3e:07:9d:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-02-17T18:07:21Z', 'updated_at': '2021-02-17T18:07:44Z', 'revision_number': 1, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3837ab39-c6c1-4f34-9b6b-47c98bdea645', 'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'mac_address': 'fa:16:3e:7a:00:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_interface', 'standard_attr_id': 120, 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:07:00Z', 'updated_at': '2021-02-17T18:07:17Z', 'revision_number': 5, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'subnets': [{'id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:47.516711 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39142b64-eb9b-4619-a434-8ad9e93d5db6 None None] Checking router: 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 for host: dv-cinder-760194-3-iscsi {{(pid=84114) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:07:47.526605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39142b64-eb9b-4619-a434-8ad9e93d5db6 None None] Routers {'26ce0b68-6f29-498d-8e7d-e9fdae0ac663'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:07:47.527268 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-39142b64-eb9b-4619-a434-8ad9e93d5db6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:07:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:47.574977 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-340655ab-8a09-410f-b322-e239dbe643cd req-489a53cc-3efb-44f4-ad29-b58b2394163f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449319 Feb 17 18:07:47.639976 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Network 2866144d-ebea-4fc7-a2ed-9a219704d84f details requested by agent ovs-agent-hv-cinder-76019 with host hv-cinder-76019 {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:07:47.664932 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:47.744885 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531955b1-4483-41bd-ad24-182aeffc446f req-cef07e93-a31d-4bb8-bb8d-c95764ee10aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:47.750383 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-531955b1-4483-41bd-ad24-182aeffc446f req-cef07e93-a31d-4bb8-bb8d-c95764ee10aa service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 1162 time: 0.0966697 Feb 17 18:07:47.766450 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-39142b64-eb9b-4619-a434-8ad9e93d5db6 None None] Set router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:07:47.841749 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ccc67706-63ae-4e23-a7ea-5ce0d44e5539 req-78bfdb5b-f2e0-4ea7-8e80-2eb6c68caaa0 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 210 time: 0.0639508 Feb 17 18:07:47.903564 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531955b1-4483-41bd-ad24-182aeffc446f req-67f6e9a0-73a8-4561-b58a-1d9e2270fc7b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:47.905229 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-531955b1-4483-41bd-ad24-182aeffc446f req-67f6e9a0-73a8-4561-b58a-1d9e2270fc7b service neutron] 10.222.0.70 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 907 time: 0.1455693 Feb 17 18:07:48.040145 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-531955b1-4483-41bd-ad24-182aeffc446f req-aeb9b398-1f11-4f4f-8751-5c50d69ecc3a service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 HTTP/1.1" status: 200 len: 998 time: 0.1074150 Feb 17 18:07:48.125070 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531955b1-4483-41bd-ad24-182aeffc446f req-af6a4be6-bbc3-4a7d-9944-ba29c22eaac1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:48.126746 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-531955b1-4483-41bd-ad24-182aeffc446f req-af6a4be6-bbc3-4a7d-9944-ba29c22eaac1 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2f43211a-7773-487d-8b86-a136c7f7c156 HTTP/1.1" status: 200 len: 852 time: 0.0700972 Feb 17 18:07:48.184548 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-39142b64-eb9b-4619-a434-8ad9e93d5db6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:07:06Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_floatingips': [{'id': '08d5d43d-cc01-43c2-86a1-6faa4c214dbe', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'floating_ip_address': '172.27.1.57', 'floating_network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'router_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'port_id': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 169, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'mac_address': 'fa:16:3e:07:9d:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-02-17T18:07:21Z', 'updated_at': '2021-02-17T18:07:44Z', 'revision_number': 1, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3837ab39-c6c1-4f34-9b6b-47c98bdea645', 'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'mac_address': 'fa:16:3e:7a:00:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_interface', 'standard_attr_id': 120, 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:07:00Z', 'updated_at': '2021-02-17T18:07:17Z', 'revision_number': 5, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'subnets': [{'id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:48.188385 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39142b64-eb9b-4619-a434-8ad9e93d5db6 None None] The sync data for ids ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'] in dv-cinder-760194-3-iscsi is: [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:07:06Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_floatingips': [{'id': '08d5d43d-cc01-43c2-86a1-6faa4c214dbe', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'floating_ip_address': '172.27.1.57', 'floating_network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'router_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'port_id': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 169, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'mac_address': 'fa:16:3e:07:9d:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-02-17T18:07:21Z', 'updated_at': '2021-02-17T18:07:44Z', 'revision_number': 1, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3837ab39-c6c1-4f34-9b6b-47c98bdea645', 'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'mac_address': 'fa:16:3e:7a:00:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_interface', 'standard_attr_id': 120, 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:07:00Z', 'updated_at': '2021-02-17T18:07:17Z', 'revision_number': 5, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'subnets': [{'id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}] {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:07:48.227121 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531955b1-4483-41bd-ad24-182aeffc446f req-5bc417c1-9753-437e-b94c-573d7edd182d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:48.228894 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-531955b1-4483-41bd-ad24-182aeffc446f req-5bc417c1-9753-437e-b94c-573d7edd182d service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0862694 Feb 17 18:07:48.384561 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-531955b1-4483-41bd-ad24-182aeffc446f req-38f5dd8e-2ea6-41f0-8c6d-dda7c1e32cfb service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1429312 Feb 17 18:07:48.567905 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-171e1ec1-1c66-4500-8de1-6e6c2b1a522e None None] New status for floating IP 08d5d43d-cc01-43c2-86a1-6faa4c214dbe: ACTIVE {{(pid=84113) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:272}} Feb 17 18:07:48.577332 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-531955b1-4483-41bd-ad24-182aeffc446f req-816a44c8-ad7b-409d-b835-f8616031c203 service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1855655 Feb 17 18:07:48.890244 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a566639-1942-4d35-96d6-b07d7daa61cc req-300ee271-d01e-47b3-8bcd-4b7749077136 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:48.892816 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2a566639-1942-4d35-96d6-b07d7daa61cc req-300ee271-d01e-47b3-8bcd-4b7749077136 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1260188 Feb 17 18:07:49.002240 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2a566639-1942-4d35-96d6-b07d7daa61cc req-ee6a8c93-c237-47f1-86cf-be3d3604b207 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0952694 Feb 17 18:07:49.168179 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bc8fcf17-e9f5-48d9-8087-a82ef87a1ea2 req-c5f53c60-d622-493c-a3b7-d4208586800f tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 210 time: 0.0781004 Feb 17 18:07:49.200429 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-f6aed1c8-6e38-446f-ad6a-296812f8323f tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:49.200429 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-f6aed1c8-6e38-446f-ad6a-296812f8323f tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "GET /v2.0/networks?id=ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 200 len: 815 time: 0.2682252 Feb 17 18:07:49.210950 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Request body: {'port': {'device_id': 'c13a0fb6-558a-4c45-afa0-ed7e0da69c21', 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4', 'admin_state_up': True, 'tenant_id': 'c2e8792284c348238cf9afdcae0c221e'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:49.371983 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:49.381902 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Usage tracker for resource:port and tenant:c2e8792284c348238cf9afdcae0c221e is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:49.385348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Quota usage for port was recalculated. Used quota:1. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:49.392770 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:49.432416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Made reservation on behalf of c2e8792284c348238cf9afdcae0c221e for: {'port': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:07:49.438383 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:49.546139 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55042) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:49.614369 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_v2 [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Deleting subnet a5b0cdf5-0893-43d1-8023-c370f1f6ab8c {{(pid=84111) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1041}} Feb 17 18:07:49.618101 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:49.681134 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:49.690642 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1550982'] for subnet, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:50.019173 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Allocated IP 172.20.0.12 (ee1c48e9-8681-4765-bc5b-bc0215d911a4/e1b65f5a-677d-4368-874f-50623d3454b9/4e092f78-701d-48e1-8837-664198422e8e) {{(pid=84112) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:07:50.021640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853224802', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for subnet, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:50.038612 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:50.191142 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a5b0cdf5-0893-43d1-8023-c370f1f6ab8c,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:50.236629 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.237021 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.237439 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.238006 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.238565 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.239324 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.240321 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.240889 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.241414 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.242434 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.243621 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.244500 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.245299 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.246066 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.246463 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.246845 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.247225 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.247606 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.248007 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.248806 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.249191 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.249566 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.249942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.250314 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:50.265397 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks [] for port, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:50.293174 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.254s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:50.324476 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:50.332208 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] Notify callbacks [] for subnet, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:50.346531 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:50.386737 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-2dfa4af6-7835-4c88-907c-111dbd513685 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/a5b0cdf5-0893-43d1-8023-c370f1f6ab8c HTTP/1.1" status: 204 len: 168 time: 0.8390989 Feb 17 18:07:50.395395 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55064) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:50.486334 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Pushing event updated for resources: {'Port': ['ID=4e092f78-701d-48e1-8837-664198422e8e,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:50.491453 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:50.503488 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655369d0-c5a1-47a8-88a5-fda844098217 req-9779fdab-19bf-4cc4-a16b-5f54b7681cfd tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:50.505204 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-655369d0-c5a1-47a8-88a5-fda844098217 req-9779fdab-19bf-4cc4-a16b-5f54b7681cfd tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.3617744 Feb 17 18:07:50.583389 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Network ee1c48e9-8681-4765-bc5b-bc0215d911a4 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:07:50.585443 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:07:50.594289 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Received port after_create {{(pid=84112) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:07:50.626218 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-655369d0-c5a1-47a8-88a5-fda844098217 req-c838d2c8-007a-4cce-bb27-a685137c0eac tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0951908 Feb 17 18:07:50.642375 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1376323'] for network, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:50.683266 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55074) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:50.723788 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b225b668-2351-45d9-81c9-22fecf52487e req-744ddc7a-2e07-41a8-90b5-d4a314208831 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:50.732636 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b225b668-2351-45d9-81c9-22fecf52487e req-744ddc7a-2e07-41a8-90b5-d4a314208831 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 932 time: 0.4040248 Feb 17 18:07:50.757369 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:50.757858 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:50.871990 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.6653941 Feb 17 18:07:50.872921 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c878bad2-6573-4651-b550-82e3d47b7793 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:50.891320 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Request body: {'port': {'device_id': 'c13a0fb6-558a-4c45-afa0-ed7e0da69c21', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:07:50.900740 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b225b668-2351-45d9-81c9-22fecf52487e req-31865db9-1f00-4135-8b04-f6ecb7c62641 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1643584 Feb 17 18:07:50.929355 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1551647', 'neutron.services.segments.db._delete_segments_for_network-8730056716045'] for network, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:50.957448 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c878bad2-6573-4651-b550-82e3d47b7793 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:50.967417 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c878bad2-6573-4651-b550-82e3d47b7793 admin admin] Usage tracker for resource:security_group_rule and tenant:c0f1e50d3ef14d85a3b774f1bd0a06bc is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:50.973520 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c878bad2-6573-4651-b550-82e3d47b7793 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:50.984135 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c878bad2-6573-4651-b550-82e3d47b7793 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:51.070725 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.071278 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.071948 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.072319 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > port after_create 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.072803 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > port after_delete 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.073235 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > port after_update 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.073640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:51.073743 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.074103 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.074587 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.074945 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.172892 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.173219 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.173599 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.174133 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=84111) subscribe /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:48}} Feb 17 18:07:51.174529 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9a6c905d-f0c9-4c01-8dcc-f31837172714']}} {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:51.200570 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c2d54292-0536-4a70-b118-0e7d52b9d0a7') {'for_net_delete': True} {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:51.200570 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c2d54292-0536-4a70-b118-0e7d52b9d0a7') {} {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:07:51.225867 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8730056711181', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2340933'] for segment, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:51.268376 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:51.271080 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Releasing vxlan tunnel 7 to pool {{(pid=84111) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:322}} Feb 17 18:07:51.335263 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c878bad2-6573-4651-b550-82e3d47b7793 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:51.376001 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c878bad2-6573-4651-b550-82e3d47b7793 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:51.434420 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ba0aa3e3-d370-4503-84c2-0ce1b9da4009 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:51.466285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Network 9a6c905d-f0c9-4c01-8dcc-f31837172714 has no segments {{(pid=84111) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:07:51.475917 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1547159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4125015'] for segment, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:51.495579 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c878bad2-6573-4651-b550-82e3d47b7793 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4beaa43f-cc49-4990-a38a-7d22ae108925,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:51.502082 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c878bad2-6573-4651-b550-82e3d47b7793 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c0f1e50d3ef14d85a3b774f1bd0a06bc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8176866 Feb 17 18:07:51.503198 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c878bad2-6573-4651-b550-82e3d47b7793 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:51.510626 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55094) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:51.632509 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-41a23ab5-02f0-47ac-8b49-421002655d99 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:51.672098 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Network 9a6c905d-f0c9-4c01-8dcc-f31837172714 has no segments {{(pid=84111) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: from cryptography.utils import int_from_bytes Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: from cryptography.utils import int_from_bytes Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/relationships.py:1998: SAWarning: Setting backref / back_populates on relationship QosNetworkPolicyBinding.port to refer to viewonly relationship Port.qos_network_policy_binding should include sync_backref=False set on the QosNetworkPolicyBinding.port relationship. (this warning may be suppressed after 10 occurrences) Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: (rel_b, rel_a, rel_b), Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/relationships.py:1998: SAWarning: Setting backref / back_populates on relationship Tag.standard_attr to refer to viewonly relationship StandardAttribute.tags should include sync_backref=False set on the Tag.standard_attr relationship. (this warning may be suppressed after 10 occurrences) Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: (rel_b, rel_a, rel_b), Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: Traceback (most recent call last): Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: timer() Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: cb(*args, **kw) Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/common/utils.py", line 973, in wrapper Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: return func(*args, **kwargs) Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: self._notify() Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: self.callback(batched_events) Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: event.method(event) Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: segment_id)['aggregates'][0] Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: return f(self, *a, **k) Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: return self._get(url).json() Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: **kwargs) Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1131, in get Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: return self.request(url, 'GET', **kwargs) Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 802, in request Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: **endpoint_filter) Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 17 18:07:51.700945 dv-cinder-760194-3-iscsi neutron-server[84000]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 17 18:07:51.714371 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-41a23ab5-02f0-47ac-8b49-421002655d99 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:51.731781 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4e092f78-701d-48e1-8837-664198422e8e {{(pid=84112) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:229}} Feb 17 18:07:51.748509 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:51.901813 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-41a23ab5-02f0-47ac-8b49-421002655d99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:51.907476 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-880ac14c-a185-4a1b-91a3-1a14212854c0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:51.925257 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a23ab5-02f0-47ac-8b49-421002655d99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4beaa43f-cc49-4990-a38a-7d22ae108925,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:51.931012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-41a23ab5-02f0-47ac-8b49-421002655d99 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:51.933301 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-41a23ab5-02f0-47ac-8b49-421002655d99 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:51.934558 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-41a23ab5-02f0-47ac-8b49-421002655d99 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/4beaa43f-cc49-4990-a38a-7d22ae108925 HTTP/1.1" status: 204 len: 168 time: 0.4282029 Feb 17 18:07:52.104819 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Transition to ACTIVE for port object 4e092f78-701d-48e1-8837-664198422e8e will not be triggered until provisioned by entity L2. {{(pid=84112) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:07:52.158218 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d25563be-ec45-41a7-ab2c-4f6ab0e8dd2b req-678eb891-789b-4b89-b077-0b8fe12860e9 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:52.159399 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:52.161960 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d25563be-ec45-41a7-ab2c-4f6ab0e8dd2b req-678eb891-789b-4b89-b077-0b8fe12860e9 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.4089127 Feb 17 18:07:52.169953 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853224169', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036854319422'] for network, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:52.177476 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:52.198057 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:52.227799 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ddd06a5-a321-472d-82ff-f10f48d5f6e9 req-0ee3525a-ea54-416f-8fa0-66f4df9985d8 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:52.232503 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1ddd06a5-a321-472d-82ff-f10f48d5f6e9 req-0ee3525a-ea54-416f-8fa0-66f4df9985d8 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 932 time: 0.1749344 Feb 17 18:07:52.233863 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Pushing event deleted for resources: {'Network': ['ID=9a6c905d-f0c9-4c01-8dcc-f31837172714,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:52.236942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:52.238320 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:52.287537 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d25563be-ec45-41a7-ab2c-4f6ab0e8dd2b req-db876418-be15-4acd-a6d1-ac7495bb77f5 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1212714 Feb 17 18:07:52.316026 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Pushing event updated for resources: {'Port': ['ID=4e092f78-701d-48e1-8837-664198422e8e,revision_number=2']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:52.317437 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1ddd06a5-a321-472d-82ff-f10f48d5f6e9 req-3507c1f8-743f-48d7-a5af-04f2de2d5aeb tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0756762 Feb 17 18:07:52.321476 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:52.354339 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-dd0c3bad-d93d-4470-96c3-b894dd4691b6 admin admin] 10.222.0.13 "DELETE /v2.0/networks/9a6c905d-f0c9-4c01-8dcc-f31837172714 HTTP/1.1" status: 204 len: 168 time: 1.9578090 Feb 17 18:07:52.530159 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55120) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:52.549967 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f68a03a6-0e64-4fc6-8560-455a39649706 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:52.573174 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Attempting to bind port 4e092f78-701d-48e1-8837-664198422e8e on host hv-cinder-76019 for vnic_type normal with profile {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:07:52.573633 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Attempting to bind port 4e092f78-701d-48e1-8837-664198422e8e by drivers openvswitch on host hv-cinder-76019 at level 0 using segments [{'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:07:52.574064 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Attempting to bind port 4e092f78-701d-48e1-8837-664198422e8e on network ee1c48e9-8681-4765-bc5b-bc0215d911a4 {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:07:52.580190 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Checking agent: {'id': '35b9bf9c-0314-48b9-bb29-ba3a04c8b13c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 18, 4, 47), 'started_at': datetime.datetime(2021, 2, 17, 18, 5, 17), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 7, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.34', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:07:52.580828 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Checking segment: {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'} for mappings: {} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:07:52.581299 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:52.582048 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Bound using segment: {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:07:52.582616 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Bound port: 4e092f78-701d-48e1-8837-664198422e8e, host: hv-cinder-76019, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'}}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:07:52.583074 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:52.593768 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f68a03a6-0e64-4fc6-8560-455a39649706 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:52.609179 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f68a03a6-0e64-4fc6-8560-455a39649706 admin admin] Usage tracker for resource:security_group_rule and tenant:71f9222824a3498ab2a7b5e5ad584361 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:52.612831 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f68a03a6-0e64-4fc6-8560-455a39649706 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:52.619703 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f68a03a6-0e64-4fc6-8560-455a39649706 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:52.652216 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55124) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:52.728752 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f68a03a6-0e64-4fc6-8560-455a39649706 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:52.739239 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-70b3a889-dd7c-4b03-be9e-36eb65771b52 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ea1a0242f4cf40fd9bd267013f65af40&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0833731 Feb 17 18:07:52.742066 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55130) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:52.742994 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] For port 4e092f78-701d-48e1-8837-664198422e8e, host hv-cinder-76019, cleared binding levels {{(pid=84112) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:07:52.748252 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] For port 4e092f78-701d-48e1-8837-664198422e8e, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=4e092f78-701d-48e1-8837-664198422e8e,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84112) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:07:52.761509 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f68a03a6-0e64-4fc6-8560-455a39649706 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:52.772093 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-38ff634d-fbfd-4356-9492-c97da9faf5a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:52.776129 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:52.792916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:52.816312 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f68a03a6-0e64-4fc6-8560-455a39649706 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=68fe33fe-7675-4bdc-83ed-114efdb3a6b7,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:52.837320 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f68a03a6-0e64-4fc6-8560-455a39649706 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:52.853397 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f68a03a6-0e64-4fc6-8560-455a39649706 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=71f9222824a3498ab2a7b5e5ad584361&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3221159 Feb 17 18:07:52.873079 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55138) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:52.947648 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e29aa315-2660-4bd3-89f4-bfaf1b5c8432 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:52.951981 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Pushing event updated for resources: {'Port': ['ID=4e092f78-701d-48e1-8837-664198422e8e,revision_number=3']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:52.965636 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:52.981035 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e29aa315-2660-4bd3-89f4-bfaf1b5c8432 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:53.013700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:53.014484 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:53.016339 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] 10.222.0.70 "PUT /v2.0/ports/4e092f78-701d-48e1-8837-664198422e8e HTTP/1.1" status: 200 len: 1158 time: 2.1313946 Feb 17 18:07:53.016941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c13a0fb6-558a-4c45-afa0-ed7e0da69c21', 'tag': '4e092f78-701d-48e1-8837-664198422e8e'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:53.033939 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0f6c4720-1131-411c-aeec-65359b42edbe admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:53.074320 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c13a0fb6-558a-4c45-afa0-ed7e0da69c21', 'tag': '4e092f78-701d-48e1-8837-664198422e8e', 'status': 'completed', 'code': 200} Feb 17 18:07:53.078107 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0f6c4720-1131-411c-aeec-65359b42edbe admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:53.164861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e29aa315-2660-4bd3-89f4-bfaf1b5c8432 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:53.175160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-600d891c-7c3d-4782-8ea6-1cd826aacd8d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:53.186030 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0f6c4720-1131-411c-aeec-65359b42edbe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:53.198895 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-066e4704-61ad-4205-9196-9637f3d42758 req-82c17476-3652-4e09-8f35-d8ad8b6ecc9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:53.200678 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-066e4704-61ad-4205-9196-9637f3d42758 req-82c17476-3652-4e09-8f35-d8ad8b6ecc9c service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 1161 time: 0.0970519 Feb 17 18:07:53.201514 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e29aa315-2660-4bd3-89f4-bfaf1b5c8432 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17e0eced-062a-4742-8379-f04c949c37d1,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:53.208026 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e29aa315-2660-4bd3-89f4-bfaf1b5c8432 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:53.212826 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.014s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:53.228748 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f6c4720-1131-411c-aeec-65359b42edbe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=68fe33fe-7675-4bdc-83ed-114efdb3a6b7,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:53.231842 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0f6c4720-1131-411c-aeec-65359b42edbe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:53.255113 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0f6c4720-1131-411c-aeec-65359b42edbe admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:53.259248 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-0f6c4720-1131-411c-aeec-65359b42edbe admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/68fe33fe-7675-4bdc-83ed-114efdb3a6b7 HTTP/1.1" status: 204 len: 168 time: 0.3798406 Feb 17 18:07:53.263119 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e29aa315-2660-4bd3-89f4-bfaf1b5c8432 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:53.267828 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e29aa315-2660-4bd3-89f4-bfaf1b5c8432 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/17e0eced-062a-4742-8379-f04c949c37d1 HTTP/1.1" status: 204 len: 168 time: 0.5236955 Feb 17 18:07:53.403660 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-066e4704-61ad-4205-9196-9637f3d42758 req-d2878ad6-66aa-468b-979a-3bace88ede94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:53.404262 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-066e4704-61ad-4205-9196-9637f3d42758 req-d2878ad6-66aa-468b-979a-3bace88ede94 service neutron] 10.222.0.70 "GET /v2.0/networks?tenant_id=c2e8792284c348238cf9afdcae0c221e&shared=False HTTP/1.1" status: 200 len: 909 time: 0.1876256 Feb 17 18:07:53.586852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-066e4704-61ad-4205-9196-9637f3d42758 req-81f53c34-ac91-49b2-9275-9b0acd4e4934 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:53.592474 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-066e4704-61ad-4205-9196-9637f3d42758 req-81f53c34-ac91-49b2-9275-9b0acd4e4934 service neutron] 10.222.0.70 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 863 time: 0.1783774 Feb 17 18:07:53.623351 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55162) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:53.645675 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be66a6d-bc22-480a-b132-f08504d4c67f req-1bf9e2fa-7880-44fd-8265-3e18adc80f30 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:53.647391 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6be66a6d-bc22-480a-b132-f08504d4c67f req-1bf9e2fa-7880-44fd-8265-3e18adc80f30 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1974831 Feb 17 18:07:53.670878 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ad9e1d2-9cf8-4499-b7a6-1f5887ed99f8 req-9581b338-edaf-47da-86b4-5650d2d593ff tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:53.680594 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8ad9e1d2-9cf8-4499-b7a6-1f5887ed99f8 req-9581b338-edaf-47da-86b4-5650d2d593ff tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 944 time: 0.1554301 Feb 17 18:07:53.731562 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-9bc49bc8-8816-45d0-830a-64992e17ba83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:53.734709 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-9bc49bc8-8816-45d0-830a-64992e17ba83 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 1161 time: 0.0897694 Feb 17 18:07:53.770831 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6be66a6d-bc22-480a-b132-f08504d4c67f req-70216804-34ee-4764-8df2-8360e3759297 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0971787 Feb 17 18:07:53.774254 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8ad9e1d2-9cf8-4499-b7a6-1f5887ed99f8 req-f1e94ad9-10bf-473d-87ee-1b3d950fd7ec tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732708 Feb 17 18:07:53.827116 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-10663894-9d82-42ca-9cbf-2d51d37964ea service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4e092f78-701d-48e1-8837-664198422e8e HTTP/1.1" status: 200 len: 217 time: 0.0840244 Feb 17 18:07:53.913549 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3b00da7a-247a-413c-b29d-69e76be4e3c4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:53.937261 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-3b00da7a-247a-413c-b29d-69e76be4e3c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:53.940490 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-af04c5fc-55c0-4623-9bda-502813d53e02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:53.942119 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-af04c5fc-55c0-4623-9bda-502813d53e02 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=e1b65f5a-677d-4368-874f-50623d3454b9 HTTP/1.1" status: 200 len: 855 time: 0.1073959 Feb 17 18:07:53.945043 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-3b00da7a-247a-413c-b29d-69e76be4e3c4 admin admin] Usage tracker for resource:security_group_rule and tenant:e9990fa51374422391d8871b89d2e901 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:53.951782 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-3b00da7a-247a-413c-b29d-69e76be4e3c4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:53.994284 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-3b00da7a-247a-413c-b29d-69e76be4e3c4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:54.021731 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55176) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:54.042454 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-06d99160-7143-4b48-abdb-5cd36cf27e91 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:54.059586 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-06d99160-7143-4b48-abdb-5cd36cf27e91 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:54.064011 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-06d99160-7143-4b48-abdb-5cd36cf27e91 admin admin] Usage tracker for resource:security_group_rule and tenant:110612ae0ae640188bf38d60e2e674b3 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:54.067273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-06d99160-7143-4b48-abdb-5cd36cf27e91 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:54.073521 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-06d99160-7143-4b48-abdb-5cd36cf27e91 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:54.182028 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-06d99160-7143-4b48-abdb-5cd36cf27e91 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:54.219742 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-881f5a01-1d1a-478f-9b46-3f4baae69b07 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=ee1c48e9-8681-4765-bc5b-bc0215d911a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2673693 Feb 17 18:07:54.221100 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-06d99160-7143-4b48-abdb-5cd36cf27e91 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:54.231381 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d0c54d33-5a15-43d2-b3e7-a47a9fe113bd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:54.272038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06d99160-7143-4b48-abdb-5cd36cf27e91 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a989e6c-4023-4477-9dcf-9265822d3ae7,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:54.286276 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-06d99160-7143-4b48-abdb-5cd36cf27e91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:54.300112 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-06d99160-7143-4b48-abdb-5cd36cf27e91 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=110612ae0ae640188bf38d60e2e674b3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2771909 Feb 17 18:07:54.300853 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55186) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:54.371082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8b9ee69-a854-4737-bda2-73def674c993 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:54.402001 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8b9ee69-a854-4737-bda2-73def674c993 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:54.425513 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-e8e01436-4bd2-468c-b71b-9c38d507e672 service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1916325 Feb 17 18:07:54.483851 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8b9ee69-a854-4737-bda2-73def674c993 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:54.489151 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-75aa3ddc-ecd2-4d36-9edb-2724254b3f8d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:54.500857 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8b9ee69-a854-4737-bda2-73def674c993 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a989e6c-4023-4477-9dcf-9265822d3ae7,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:54.504483 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c8b9ee69-a854-4737-bda2-73def674c993 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:54.511176 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8b9ee69-a854-4737-bda2-73def674c993 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:54.516071 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c8b9ee69-a854-4737-bda2-73def674c993 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8a989e6c-4023-4477-9dcf-9265822d3ae7 HTTP/1.1" status: 204 len: 168 time: 0.2135651 Feb 17 18:07:54.577285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3b00da7a-247a-413c-b29d-69e76be4e3c4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:54.613841 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3b00da7a-247a-413c-b29d-69e76be4e3c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:54.627361 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ea5766b6-2169-4976-ad2f-f5a41cc380d1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:54.663982 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a01094e1-4353-471e-a73f-92b46029d0f7 req-55bbeda4-d638-4369-9b06-172d0c7edafc service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2244353 Feb 17 18:07:54.699655 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3b00da7a-247a-413c-b29d-69e76be4e3c4 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e9990fa51374422391d8871b89d2e901&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0724511 Feb 17 18:07:54.699655 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b00da7a-247a-413c-b29d-69e76be4e3c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d53526e-251d-4e12-bdd9-70224d7bf1e4,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:54.699810 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55202) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:54.710917 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3b00da7a-247a-413c-b29d-69e76be4e3c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:54.777444 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e50ca15b-10cd-4ecf-94a8-32b4087b8bc4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:54.806712 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e50ca15b-10cd-4ecf-94a8-32b4087b8bc4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:54.912566 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e50ca15b-10cd-4ecf-94a8-32b4087b8bc4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:54.965776 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-adc0f75f-863d-4835-ab88-53e17782ec08 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:55.060000 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e50ca15b-10cd-4ecf-94a8-32b4087b8bc4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d53526e-251d-4e12-bdd9-70224d7bf1e4,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:55.107473 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e50ca15b-10cd-4ecf-94a8-32b4087b8bc4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:55.112604 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e50ca15b-10cd-4ecf-94a8-32b4087b8bc4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:55.114078 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e50ca15b-10cd-4ecf-94a8-32b4087b8bc4 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7d53526e-251d-4e12-bdd9-70224d7bf1e4 HTTP/1.1" status: 204 len: 168 time: 0.4132731 Feb 17 18:07:55.189319 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92df3a4-6285-4bd7-94c1-f3f9ac0361da req-d35cf537-239a-48b5-9090-e4401dd56627 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:55.191897 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d92df3a4-6285-4bd7-94c1-f3f9ac0361da req-d35cf537-239a-48b5-9090-e4401dd56627 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.2036369 Feb 17 18:07:55.203446 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95281ae-67da-4ef2-8115-5840e874259e req-1f6c45f5-89f2-4c0d-ba4e-d98efecd9446 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:55.211574 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d95281ae-67da-4ef2-8115-5840e874259e req-1f6c45f5-89f2-4c0d-ba4e-d98efecd9446 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 944 time: 0.2944634 Feb 17 18:07:55.300886 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d95281ae-67da-4ef2-8115-5840e874259e req-0fbe50e1-9954-40d0-8e69-7efcf9d52678 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0881350 Feb 17 18:07:55.334807 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d92df3a4-6285-4bd7-94c1-f3f9ac0361da req-cbbea58c-e84b-4ff6-8570-b531552a0111 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1199231 Feb 17 18:07:55.724988 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55240) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:55.749005 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a60c5203-3379-49f0-9548-281ba4b08f68 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:55.767852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-a60c5203-3379-49f0-9548-281ba4b08f68 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:55.773138 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-a60c5203-3379-49f0-9548-281ba4b08f68 admin admin] Usage tracker for resource:security_group_rule and tenant:e8f8993bdd3842c7908f129822bf37b3 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:55.776934 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-a60c5203-3379-49f0-9548-281ba4b08f68 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:55.783971 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-a60c5203-3379-49f0-9548-281ba4b08f68 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:55.879525 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a60c5203-3379-49f0-9548-281ba4b08f68 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:55.912163 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a60c5203-3379-49f0-9548-281ba4b08f68 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:55.921983 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e29aa315-2660-4bd3-89f4-bfaf1b5c8432 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:55.965933 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-a60c5203-3379-49f0-9548-281ba4b08f68 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e8f8993bdd3842c7908f129822bf37b3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2394609 Feb 17 18:07:55.967809 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a60c5203-3379-49f0-9548-281ba4b08f68 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ae82852-2823-45d7-8f80-aaf539f9e2b5,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:55.969210 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55250) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:55.973537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a60c5203-3379-49f0-9548-281ba4b08f68 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:56.035006 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-855b9b01-6a7e-4528-a62c-23b3f5efef34 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:56.062681 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-855b9b01-6a7e-4528-a62c-23b3f5efef34 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:56.140785 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-855b9b01-6a7e-4528-a62c-23b3f5efef34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:56.146047 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-41a23ab5-02f0-47ac-8b49-421002655d99 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:56.160822 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-855b9b01-6a7e-4528-a62c-23b3f5efef34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ae82852-2823-45d7-8f80-aaf539f9e2b5,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:56.163517 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-855b9b01-6a7e-4528-a62c-23b3f5efef34 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:56.170508 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-855b9b01-6a7e-4528-a62c-23b3f5efef34 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:56.171759 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-855b9b01-6a7e-4528-a62c-23b3f5efef34 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7ae82852-2823-45d7-8f80-aaf539f9e2b5 HTTP/1.1" status: 204 len: 168 time: 0.2014599 Feb 17 18:07:56.680889 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e6146a3-6b0a-43af-b584-073251b41cad req-1c71a9fd-66d6-448f-b0f4-3cdff88780f8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:56.682533 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0e6146a3-6b0a-43af-b584-073251b41cad req-1c71a9fd-66d6-448f-b0f4-3cdff88780f8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1881971 Feb 17 18:07:56.696904 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b3182a9-f914-47c6-a3cb-698e6acfacfb req-16d746e9-a558-4d58-be9c-968465a4bd7e tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:56.698513 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7b3182a9-f914-47c6-a3cb-698e6acfacfb req-16d746e9-a558-4d58-be9c-968465a4bd7e tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 944 time: 0.2694554 Feb 17 18:07:56.782592 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0e6146a3-6b0a-43af-b584-073251b41cad req-36887ee9-85aa-4f12-ace9-2756398f6d23 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0830302 Feb 17 18:07:56.785436 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7b3182a9-f914-47c6-a3cb-698e6acfacfb req-96807f14-6696-499b-84a3-37b97244764c tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664947 Feb 17 18:07:58.080109 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd8a9177-0082-4da3-807c-79c56a8c4b79 req-06f937f7-74a9-4364-821e-f022dd84a9cf tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:58.088170 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cd8a9177-0082-4da3-807c-79c56a8c4b79 req-06f937f7-74a9-4364-821e-f022dd84a9cf tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1776273 Feb 17 18:07:58.096875 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-447bdf09-12df-4399-9b3f-da8b76747607 req-8155c5d8-00e3-4340-9277-c286a9af8e95 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:58.098434 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-447bdf09-12df-4399-9b3f-da8b76747607 req-8155c5d8-00e3-4340-9277-c286a9af8e95 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 944 time: 0.1488380 Feb 17 18:07:58.160598 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cd8a9177-0082-4da3-807c-79c56a8c4b79 req-ac0c72b4-42a7-42cd-8912-402635b2fafe tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713351 Feb 17 18:07:58.217075 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-447bdf09-12df-4399-9b3f-da8b76747607 req-5e410f77-28bb-46aa-b7a4-35261ce52826 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0953236 Feb 17 18:07:58.512479 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 4e092f78-701d-48e1-8837-664198422e8e up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:07:58.632263 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning for port 4e092f78-701d-48e1-8837-664198422e8e completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:07:58.638316 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 4e092f78-701d-48e1-8837-664198422e8e triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:07:58.638748 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:58.744944 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55372) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:58.808950 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:58.854072 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c13a0fb6-558a-4c45-afa0-ed7e0da69c21', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4e092f78-701d-48e1-8837-664198422e8e'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:07:58.865413 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port 4e092f78-701d-48e1-8837-664198422e8e, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=4e092f78-701d-48e1-8837-664198422e8e,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:07:58.889501 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:58.891662 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a6afb838-9479-4da1-9d0f-5a2708403dcb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:58.933237 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c13a0fb6-558a-4c45-afa0-ed7e0da69c21', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4e092f78-701d-48e1-8837-664198422e8e', 'code': 200} Feb 17 18:07:58.935734 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-119e1218-2b3b-461c-aad4-680932a0cc13 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:58.959274 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-119e1218-2b3b-461c-aad4-680932a0cc13 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:07:58.967783 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-119e1218-2b3b-461c-aad4-680932a0cc13 admin admin] Usage tracker for resource:security_group_rule and tenant:5e194db3522a48ec899b752e6f277233 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:07:58.971694 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-119e1218-2b3b-461c-aad4-680932a0cc13 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:07:58.976310 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=4e092f78-701d-48e1-8837-664198422e8e,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:58.979959 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-119e1218-2b3b-461c-aad4-680932a0cc13 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:07:58.984497 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.984895 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.985443 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.985830 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.986211 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.986591 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.987098 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.987475 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.987849 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.988247 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.988621 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.989068 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.990711 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.991102 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.991492 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.992047 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.992454 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.992835 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.993210 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.993583 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.993971 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.994349 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.994794 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.995072 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:07:58.999520 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:59.077226 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-119e1218-2b3b-461c-aad4-680932a0cc13 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:59.112326 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-119e1218-2b3b-461c-aad4-680932a0cc13 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:59.121765 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-afded8d7-1b68-44a0-8c7d-a8e574d7933c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:59.170029 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-119e1218-2b3b-461c-aad4-680932a0cc13 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5e194db3522a48ec899b752e6f277233&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4214165 Feb 17 18:07:59.171036 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55392) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:07:59.171846 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-119e1218-2b3b-461c-aad4-680932a0cc13 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d81236e-8a39-4e6a-b59f-babb8f98cb01,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:59.175400 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-119e1218-2b3b-461c-aad4-680932a0cc13 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:59.276237 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-661383d2-2049-4bd2-8c0b-413578366979 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:59.315027 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-661383d2-2049-4bd2-8c0b-413578366979 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:59.462207 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-661383d2-2049-4bd2-8c0b-413578366979 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:59.469989 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3e5e814c-9f0a-437f-aca5-44819cc88039 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:07:59.485258 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-661383d2-2049-4bd2-8c0b-413578366979 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d81236e-8a39-4e6a-b59f-babb8f98cb01,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:07:59.488258 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-661383d2-2049-4bd2-8c0b-413578366979 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:07:59.496747 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-661383d2-2049-4bd2-8c0b-413578366979 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:07:59.501803 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-661383d2-2049-4bd2-8c0b-413578366979 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6d81236e-8a39-4e6a-b59f-babb8f98cb01 HTTP/1.1" status: 204 len: 168 time: 0.3287685 Feb 17 18:07:59.502897 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa74fe60-f828-4a10-8a1f-747a3e99dc16 req-8ce8ccd8-a203-4c46-b1db-c7b70e0c22e8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:59.513225 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-aa74fe60-f828-4a10-8a1f-747a3e99dc16 req-8ce8ccd8-a203-4c46-b1db-c7b70e0c22e8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.2037749 Feb 17 18:07:59.513944 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5004d1-cfcb-43ef-8a5a-afea74300169 req-79c232d3-b85b-4067-a01b-1d6cd4bcd5da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:59.515690 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1d5004d1-cfcb-43ef-8a5a-afea74300169 req-79c232d3-b85b-4067-a01b-1d6cd4bcd5da service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 1163 time: 0.1384408 Feb 17 18:07:59.563983 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-aa74fe60-f828-4a10-8a1f-747a3e99dc16 req-bc92c32c-bb5d-4667-8117-09385dc8d3e3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494268 Feb 17 18:07:59.581347 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1d5004d1-cfcb-43ef-8a5a-afea74300169 req-cd74123b-96c5-4cbc-b5b4-1974a1dfa339 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570948 Feb 17 18:07:59.612581 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d039992e-575a-460e-b9b9-50e0e0b33485 req-57b671e5-2e1d-4413-91cd-a8137185cb00 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:07:59.614261 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d039992e-575a-460e-b9b9-50e0e0b33485 req-57b671e5-2e1d-4413-91cd-a8137185cb00 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 946 time: 0.2051919 Feb 17 18:07:59.692348 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d039992e-575a-460e-b9b9-50e0e0b33485 req-392ea382-68e2-435a-93f6-6167478bba79 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666792 Feb 17 18:07:59.916195 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 4e092f78-701d-48e1-8837-664198422e8e up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:00.002038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 4e092f78-701d-48e1-8837-664198422e8e triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:00.002731 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:00.437688 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55446) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:00.552333 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-6002824-network', 'tenant_id': 'b1cf694474c0491d93d574af2b2bceeb'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:00.557823 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:00.561888 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Usage tracker for resource:network and tenant:b1cf694474c0491d93d574af2b2bceeb is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:00.564947 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:00.570942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:00.603632 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Made reservation on behalf of b1cf694474c0491d93d574af2b2bceeb for: {'network': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:08:00.608556 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:00.623072 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:00.638855 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:00.643038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Usage tracker for resource:security_group_rule and tenant:b1cf694474c0491d93d574af2b2bceeb is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:00.646053 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:00.651836 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:00.741746 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:00.791353 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bda2e42d-946b-4ed2-b877-74d10362317b req-4d1ab6f7-c9c8-4903-a509-d712396e0056 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:00.792313 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:00.799754 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bda2e42d-946b-4ed2-b877-74d10362317b req-4d1ab6f7-c9c8-4903-a509-d712396e0056 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1065366 Feb 17 18:08:00.816143 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:00.828148 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] vxlan segment allocate from pool success with {'vxlan_vni': 7} {{(pid=84112) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:151}} Feb 17 18:08:00.862145 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment--9223363306798059772', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:00.862599 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Added segment a45af54e-2b36-4f06-9307-68aa94af437e of type vxlan for network 1800276f-b949-479f-aed9-1f68503c0afc Feb 17 18:08:00.863915 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70055f11-c17a-47be-b4e0-6020a600ddc5,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:00.867408 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:00.907350 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bda2e42d-946b-4ed2-b877-74d10362317b req-6afe7f61-a079-4add-92a8-d08b2e31d26c tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065853 Feb 17 18:08:00.939016 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a333f99c-c0cf-445d-9c24-06e462765d4d req-b5db45f8-d2b6-4506-9e6f-b5e0a25012bd tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:00.940635 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a333f99c-c0cf-445d-9c24-06e462765d4d req-b5db45f8-d2b6-4506-9e6f-b5e0a25012bd tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 946 time: 0.1072683 Feb 17 18:08:00.960646 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:00.998844 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a333f99c-c0cf-445d-9c24-06e462765d4d req-7067e113-3df6-4dfa-828b-d4a77b3a378e tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509007 Feb 17 18:08:01.089251 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:01.090594 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:01.091300 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:01.141631 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:01.186478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55472) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:01.240528 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55482) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:01.240717 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 872 time: 0.8016498 Feb 17 18:08:01.249244 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Request body: {'subnet': {'network_id': '1800276f-b949-479f-aed9-1f68503c0afc', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-6002824-subnet', 'tenant_id': 'b1cf694474c0491d93d574af2b2bceeb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:01.257042 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:01.293652 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Pushing event updated for resources: {'Network': ['ID=1800276f-b949-479f-aed9-1f68503c0afc,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:01.297396 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Usage tracker for resource:subnet and tenant:b1cf694474c0491d93d574af2b2bceeb is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:01.303205 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:01.309851 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:01.316029 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network 1800276f-b949-479f-aed9-1f68503c0afc details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:08:01.329617 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:01.345773 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Network 1800276f-b949-479f-aed9-1f68503c0afc details requested by agent ovs-agent-hv-cinder-76019 with host hv-cinder-76019 {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:08:01.369674 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-266e89ba-1d90-49ac-a98a-68a39c1e42f6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:01.387153 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Made reservation on behalf of b1cf694474c0491d93d574af2b2bceeb for: {'subnet': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:08:01.391833 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create--9223372036845088803'] for subnet, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:01.405799 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-266e89ba-1d90-49ac-a98a-68a39c1e42f6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:01.466259 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-266e89ba-1d90-49ac-a98a-68a39c1e42f6 admin admin] Usage tracker for resource:security_group_rule and tenant:84140d2b48d546b497f7ac57cdafef0e is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:01.469681 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-266e89ba-1d90-49ac-a98a-68a39c1e42f6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:01.482190 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-266e89ba-1d90-49ac-a98a-68a39c1e42f6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:01.750920 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-266e89ba-1d90-49ac-a98a-68a39c1e42f6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:01.821388 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-266e89ba-1d90-49ac-a98a-68a39c1e42f6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:01.830811 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e8ed8b3f-ebe9-48dc-be27-24431528fca6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:01.892627 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 4e092f78-701d-48e1-8837-664198422e8e up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:01.892747 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-266e89ba-1d90-49ac-a98a-68a39c1e42f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a248f265-5cde-4d96-a678-fdb9faf7e191,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:01.900497 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-266e89ba-1d90-49ac-a98a-68a39c1e42f6 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=84140d2b48d546b497f7ac57cdafef0e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7098448 Feb 17 18:08:01.900497 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-266e89ba-1d90-49ac-a98a-68a39c1e42f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:01.901387 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55510) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:01.991756 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 4e092f78-701d-48e1-8837-664198422e8e triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:01.992238 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:02.033067 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-19325ec2-6fd7-4eb8-b2b6-bffe31526046 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:02.114625 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:08:02.117920 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-19325ec2-6fd7-4eb8-b2b6-bffe31526046 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:02.171106 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4126701', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create--9223372036845088820'] for subnet, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:02.181891 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:02.237795 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-19325ec2-6fd7-4eb8-b2b6-bffe31526046 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:02.245235 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3ecfbd03-1cff-4d85-8d58-4cc1880fb99a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:02.262237 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19325ec2-6fd7-4eb8-b2b6-bffe31526046 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a248f265-5cde-4d96-a678-fdb9faf7e191,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:02.265592 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-19325ec2-6fd7-4eb8-b2b6-bffe31526046 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:02.267681 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-19325ec2-6fd7-4eb8-b2b6-bffe31526046 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:02.271738 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-19325ec2-6fd7-4eb8-b2b6-bffe31526046 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a248f265-5cde-4d96-a678-fdb9faf7e191 HTTP/1.1" status: 204 len: 168 time: 0.3653898 Feb 17 18:08:02.631620 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Pushing event updated for resources: {'Subnet': ['ID=454e1bd3-ed8a-471d-bca5-14fd752ac4a6,revision_number=0']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:02.638394 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.456s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:02.666099 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-871e2342-df09-41c5-bf52-c54e622a575d req-cba1002f-8ae7-4bf9-9fde-bca24e5efd4e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:02.667710 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-871e2342-df09-41c5-bf52-c54e622a575d req-cba1002f-8ae7-4bf9-9fde-bca24e5efd4e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.5823598 Feb 17 18:08:02.743281 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-220689b9-b021-4e18-99be-c070b1dc5b98 req-5d4e9441-25d6-4866-ba31-9b41c3df21ed tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:02.744910 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-220689b9-b021-4e18-99be-c070b1dc5b98 req-5d4e9441-25d6-4866-ba31-9b41c3df21ed tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 946 time: 0.2231653 Feb 17 18:08:02.762239 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-871e2342-df09-41c5-bf52-c54e622a575d req-3109a356-fe38-4f14-976f-0e911aff8875 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0874963 Feb 17 18:08:02.774894 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55536) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:02.803127 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-96ec1b19-cdc0-4072-80df-8ef22c5c5524 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:02.821111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Checking segment: {'id': 'a45af54e-2b36-4f06-9307-68aa94af437e', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '1800276f-b949-479f-aed9-1f68503c0afc'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84111) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:08:02.821111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Network hostable DHCP agents. Network: 1800276f-b949-479f-aed9-1f68503c0afc, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84111) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 18:08:02.821340 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-96ec1b19-cdc0-4072-80df-8ef22c5c5524 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:02.825115 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-96ec1b19-cdc0-4072-80df-8ef22c5c5524 admin admin] Usage tracker for resource:security_group_rule and tenant:83b0526f9b634f748a1b11389387ecf0 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:02.827512 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-220689b9-b021-4e18-99be-c070b1dc5b98 req-6d366208-a625-43f1-ad69-1818e4f8a9df tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710056 Feb 17 18:08:02.828183 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-96ec1b19-cdc0-4072-80df-8ef22c5c5524 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:02.836883 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-96ec1b19-cdc0-4072-80df-8ef22c5c5524 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:02.873701 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Network 1800276f-b949-479f-aed9-1f68503c0afc is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84111) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 18:08:02.912369 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, 1800276f-b949-479f-aed9-1f68503c0afc) {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:08:02.925741 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b028a8c-96df-4fc4-9187-9fea613dc7ae None None] Network 1800276f-b949-479f-aed9-1f68503c0afc requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:08:02.930565 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:02.931208 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] Notify callbacks [] for subnet, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:02.932753 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-96ec1b19-cdc0-4072-80df-8ef22c5c5524 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:02.964158 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-96ec1b19-cdc0-4072-80df-8ef22c5c5524 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:02.978458 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:02.987349 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-71175ed4-efa9-491b-8958-4e2bd0478342 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 843 time: 1.7449276 Feb 17 18:08:03.032196 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-96ec1b19-cdc0-4072-80df-8ef22c5c5524 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=83b0526f9b634f748a1b11389387ecf0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2529633 Feb 17 18:08:03.032196 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96ec1b19-cdc0-4072-80df-8ef22c5c5524 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b70760b4-c670-4412-bf67-c044d2420d74,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:03.033458 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55546) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:03.036777 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-96ec1b19-cdc0-4072-80df-8ef22c5c5524 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:03.105281 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7d42dff9-c622-4482-b1e7-9541b8b8b10f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:03.136585 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7d42dff9-c622-4482-b1e7-9541b8b8b10f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:03.220929 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7d42dff9-c622-4482-b1e7-9541b8b8b10f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:03.236386 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-01ca7997-40da-4b30-ad78-a946569c3357 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:03.247334 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d42dff9-c622-4482-b1e7-9541b8b8b10f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b70760b4-c670-4412-bf67-c044d2420d74,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:03.262969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7d42dff9-c622-4482-b1e7-9541b8b8b10f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:03.264209 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7d42dff9-c622-4482-b1e7-9541b8b8b10f admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:03.265454 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-7d42dff9-c622-4482-b1e7-9541b8b8b10f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b70760b4-c670-4412-bf67-c044d2420d74 HTTP/1.1" status: 204 len: 168 time: 0.2309954 Feb 17 18:08:03.283650 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f61e220-fa6f-4355-bb00-73b873a38286 None None] Network 1800276f-b949-479f-aed9-1f68503c0afc requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:08:04.011419 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6adc6b6e-e620-4189-bdf9-768c5d6aad17 req-847d9a2f-952a-4e76-a25b-3c3906143cff tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:04.013485 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6adc6b6e-e620-4189-bdf9-768c5d6aad17 req-847d9a2f-952a-4e76-a25b-3c3906143cff tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1104360 Feb 17 18:08:04.071522 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6adc6b6e-e620-4189-bdf9-768c5d6aad17 req-0e2c39d0-2791-4b70-ab36-ef7b008ebf76 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498695 Feb 17 18:08:05.337018 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05fd2988-143a-4fc9-813b-f82295dbe6ae req-137c1e88-9259-4781-952d-5b5a8a328292 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:05.347168 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-05fd2988-143a-4fc9-813b-f82295dbe6ae req-137c1e88-9259-4781-952d-5b5a8a328292 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1478357 Feb 17 18:08:05.413823 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-05fd2988-143a-4fc9-813b-f82295dbe6ae req-f3bc91f2-e95e-4ec6-a8c3-aeff369ed5ec tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0616822 Feb 17 18:08:05.801970 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-8d37d14f-b1a8-495c-ba59-c23d6d6789e7 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:05.808601 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-8d37d14f-b1a8-495c-ba59-c23d6d6789e7 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/networks?id=1800276f-b949-479f-aed9-1f68503c0afc HTTP/1.1" status: 200 len: 806 time: 0.1756048 Feb 17 18:08:05.821134 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-ee1ca045-4cad-44d7-bbce-7290e866d0fd tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/quotas/b1cf694474c0491d93d574af2b2bceeb HTTP/1.1" status: 200 len: 375 time: 0.0107613 Feb 17 18:08:05.880721 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-a71f2668-90b9-4a36-b9a0-a8e00bacac1a tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=b1cf694474c0491d93d574af2b2bceeb&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0532029 Feb 17 18:08:06.047030 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-951f21ec-5e78-491f-905e-76545ecde31f service neutron] 10.222.0.13 "GET /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1571150 Feb 17 18:08:06.196780 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-4abb73cc-8426-451b-9f87-774edacca017 service neutron] 10.222.0.13 "GET /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1488037 Feb 17 18:08:06.472804 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7033b550-30b4-40f9-84e9-1e4bc6c5140b req-fb1409ed-acd5-4067-8b2d-ceb59167e5ae tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 210 time: 0.0497148 Feb 17 18:08:06.759491 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a25345-a47c-40a6-9510-a6188727220c req-8b3a97f7-f43f-4343-8dbe-c77c9a1fa494 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:06.761772 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c5a25345-a47c-40a6-9510-a6188727220c req-8b3a97f7-f43f-4343-8dbe-c77c9a1fa494 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.0961368 Feb 17 18:08:06.817201 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c5a25345-a47c-40a6-9510-a6188727220c req-c41d2d08-efb2-4953-a719-0ddbc2035f7d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491028 Feb 17 18:08:06.831768 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55736) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:07.059041 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fc732e06-0dc4-4b92-a316-87367a1162ef admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:07.061886 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cda83b4-a61a-4195-829e-c94539474101 req-c60b5514-89b6-4cd0-abb9-5f40407d4d54 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:07.064166 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-c60b5514-89b6-4cd0-abb9-5f40407d4d54 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/networks?id=ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 200 len: 815 time: 0.2249639 Feb 17 18:08:07.082763 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-fc732e06-0dc4-4b92-a316-87367a1162ef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:07.084407 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-44516b28-f88f-42c4-aa80-79e8187601e6 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/quotas/c2e8792284c348238cf9afdcae0c221e HTTP/1.1" status: 200 len: 375 time: 0.0115592 Feb 17 18:08:07.088610 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-fc732e06-0dc4-4b92-a316-87367a1162ef admin admin] Usage tracker for resource:security_group_rule and tenant:8f81baaec1b74458804967cc83242065 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:07.091699 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-fc732e06-0dc4-4b92-a316-87367a1162ef admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:07.098200 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-fc732e06-0dc4-4b92-a316-87367a1162ef admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:07.157397 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55754) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:07.187911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fc732e06-0dc4-4b92-a316-87367a1162ef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:07.235950 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-a4e38ac0-6be5-4b00-bc03-c7a563ddcc46 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1458502 Feb 17 18:08:07.243683 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_v2 [None req-d747ced5-b95b-47fe-b036-9b64744ac85f admin admin] Deleting subnet 7b0b79d1-a638-448b-805c-5f1c37b05f9c {{(pid=84111) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1041}} Feb 17 18:08:07.244129 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fc732e06-0dc4-4b92-a316-87367a1162ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:07.254135 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6648c789-7d64-4ea2-8597-3789417129f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:07.269770 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d747ced5-b95b-47fe-b036-9b64744ac85f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:07.302576 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-fc732e06-0dc4-4b92-a316-87367a1162ef admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8f81baaec1b74458804967cc83242065&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4670329 Feb 17 18:08:07.302576 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc732e06-0dc4-4b92-a316-87367a1162ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=131c7211-e066-4d40-bc15-1a8592a5d834,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:07.304476 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fc732e06-0dc4-4b92-a316-87367a1162ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:07.305156 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55762) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:07.368630 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c2701685-fa4e-4ecd-87f7-34a62421f744 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:07.396691 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c2701685-fa4e-4ecd-87f7-34a62421f744 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:07.397938 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d747ced5-b95b-47fe-b036-9b64744ac85f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036852434851'] for subnet, precommit_delete_associations {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:07.473070 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c2701685-fa4e-4ecd-87f7-34a62421f744 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:07.481594 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c878bad2-6573-4651-b550-82e3d47b7793 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:07.494921 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2701685-fa4e-4ecd-87f7-34a62421f744 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=131c7211-e066-4d40-bc15-1a8592a5d834,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:07.497603 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-501c720d-992a-46af-babc-62dc50c71ff2 service neutron] 10.222.0.13 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2514744 Feb 17 18:08:07.498815 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d747ced5-b95b-47fe-b036-9b64744ac85f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1550982'] for subnet, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:07.504980 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c2701685-fa4e-4ecd-87f7-34a62421f744 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:07.516441 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c2701685-fa4e-4ecd-87f7-34a62421f744 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:07.516441 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c2701685-fa4e-4ecd-87f7-34a62421f744 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/131c7211-e066-4d40-bc15-1a8592a5d834 HTTP/1.1" status: 204 len: 168 time: 0.2095354 Feb 17 18:08:07.684749 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55774) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:07.848512 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2447dafd-df1a-4286-a7b7-8dc429159465 req-bf180114-ed20-4633-9f65-185d41b40096 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 210 time: 0.1553028 Feb 17 18:08:07.866269 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f221c0a9-3a11-4fa4-9526-19010ed0d75d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:07.898245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ee79ad66-22b0-4812-a691-ea705599a0d1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:07.916793 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-a1efd3a2-d69a-4eeb-a941-09fcbda8b285 service neutron] 10.222.0.13 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.3668356 Feb 17 18:08:07.918900 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-ee79ad66-22b0-4812-a691-ea705599a0d1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:07.934113 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-ee79ad66-22b0-4812-a691-ea705599a0d1 admin admin] Usage tracker for resource:security_group_rule and tenant:29fcf464a2f64148bdb765fbd68d0e74 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:07.938365 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-ee79ad66-22b0-4812-a691-ea705599a0d1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:07.957285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-ee79ad66-22b0-4812-a691-ea705599a0d1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:08.135222 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d747ced5-b95b-47fe-b036-9b64744ac85f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853224802', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted--9223372036850649176', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9686835'] for subnet, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:08.181634 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ee79ad66-22b0-4812-a691-ea705599a0d1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:08.224430 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:08.232467 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ee79ad66-22b0-4812-a691-ea705599a0d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:08.242731 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:08.291044 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-ee79ad66-22b0-4812-a691-ea705599a0d1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=29fcf464a2f64148bdb765fbd68d0e74&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6018083 Feb 17 18:08:08.291044 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee79ad66-22b0-4812-a691-ea705599a0d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=66d3bcab-ae78-4e98-ba84-0b67ae22cbd6,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:08.293110 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55790) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:08.323232 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ee79ad66-22b0-4812-a691-ea705599a0d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:08.326253 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55796) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:08.357547 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d747ced5-b95b-47fe-b036-9b64744ac85f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7b0b79d1-a638-448b-805c-5f1c37b05f9c,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:08.362141 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e62e1e7a-10c8-4e77-9798-516c18024bc9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:08.382427 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d747ced5-b95b-47fe-b036-9b64744ac85f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:08.384967 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-80f62194-59ec-4210-9439-633cfa384074 req-6005c83a-e0b3-4135-ba77-7ba574e6442c tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 210 time: 0.1628013 Feb 17 18:08:08.395577 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e62e1e7a-10c8-4e77-9798-516c18024bc9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:08.402288 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4213fcd7-2c0e-4079-a91e-afb788667ebf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:08.404314 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e62e1e7a-10c8-4e77-9798-516c18024bc9 admin admin] Usage tracker for resource:security_group_rule and tenant:4bf2c26178f24ca1807eb69950033a1e is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:08.409261 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e62e1e7a-10c8-4e77-9798-516c18024bc9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:08.425502 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e62e1e7a-10c8-4e77-9798-516c18024bc9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:08.433751 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d747ced5-b95b-47fe-b036-9b64744ac85f admin admin] Notify callbacks [] for subnet, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:08.442676 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-d747ced5-b95b-47fe-b036-9b64744ac85f admin admin] 10.222.0.13 "DELETE /v2.0/subnets/7b0b79d1-a638-448b-805c-5f1c37b05f9c HTTP/1.1" status: 204 len: 168 time: 1.2818804 Feb 17 18:08:08.444583 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55802) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:08.445903 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4213fcd7-2c0e-4079-a91e-afb788667ebf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:08.541592 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a71b3ba-ede2-42b1-bc73-69ff1cb34255 req-4e96761a-3399-4489-914b-604714bf0c5e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:08.543204 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9a71b3ba-ede2-42b1-bc73-69ff1cb34255 req-4e96761a-3399-4489-914b-604714bf0c5e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.3197706 Feb 17 18:08:08.588247 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e62e1e7a-10c8-4e77-9798-516c18024bc9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:08.592579 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4213fcd7-2c0e-4079-a91e-afb788667ebf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:08.607452 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-19325ec2-6fd7-4eb8-b2b6-bffe31526046 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:08.622627 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4213fcd7-2c0e-4079-a91e-afb788667ebf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=66d3bcab-ae78-4e98-ba84-0b67ae22cbd6,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:08.721734 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-4213fcd7-2c0e-4079-a91e-afb788667ebf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:08.729206 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e62e1e7a-10c8-4e77-9798-516c18024bc9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:08.747110 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3b00da7a-247a-413c-b29d-69e76be4e3c4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:08.796568 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4213fcd7-2c0e-4079-a91e-afb788667ebf admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:08.797780 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-4213fcd7-2c0e-4079-a91e-afb788667ebf admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/66d3bcab-ae78-4e98-ba84-0b67ae22cbd6 HTTP/1.1" status: 204 len: 168 time: 0.5037031 Feb 17 18:08:08.822866 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e62e1e7a-10c8-4e77-9798-516c18024bc9 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4bf2c26178f24ca1807eb69950033a1e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4924598 Feb 17 18:08:08.825993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e62e1e7a-10c8-4e77-9798-516c18024bc9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a474804-14ed-4fd6-a9c0-d5c8052031d4,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:08.829672 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55808) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:08.830765 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e62e1e7a-10c8-4e77-9798-516c18024bc9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:08.838200 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1376323'] for network, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:08.878597 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-a9419140-7eae-4aba-aa65-b9bcbd951fb8 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:08.879512 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-a9419140-7eae-4aba-aa65-b9bcbd951fb8 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Synchronizing usage tracker for tenant:b1cf694474c0491d93d574af2b2bceeb on resource:network {{(pid=84112) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:08:08.935464 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-a9419140-7eae-4aba-aa65-b9bcbd951fb8 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Unset dirty status for tenant:b1cf694474c0491d93d574af2b2bceeb on resource:network {{(pid=84112) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:08:08.937153 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-a9419140-7eae-4aba-aa65-b9bcbd951fb8 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.70 "GET /v2.0/networks?id=1800276f-b949-479f-aed9-1f68503c0afc HTTP/1.1" status: 200 len: 806 time: 0.3074782 Feb 17 18:08:08.949810 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9a71b3ba-ede2-42b1-bc73-69ff1cb34255 req-11247029-698c-436c-afb9-361f8327276a tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1699097 Feb 17 18:08:08.953026 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Request body: {'port': {'device_id': '596a74f3-0846-461e-8720-0b7935f957ee', 'network_id': '1800276f-b949-479f-aed9-1f68503c0afc', 'admin_state_up': True, 'tenant_id': 'b1cf694474c0491d93d574af2b2bceeb'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:09.163231 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:09.169930 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Usage tracker for resource:port and tenant:b1cf694474c0491d93d574af2b2bceeb is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:09.174514 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Quota usage for port was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:09.174978 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-eb2dfb06-9408-484a-b1ef-974539acf54a req-2748f5f0-95ce-4ef3-80f7-467e9f168537 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 210 time: 0.0967891 Feb 17 18:08:09.182902 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:09.199383 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1551647', 'neutron.services.segments.db._delete_segments_for_network-8730056716045'] for network, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:09.227345 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Made reservation on behalf of b1cf694474c0491d93d574af2b2bceeb for: {'port': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:08:09.235539 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:09.289516 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fc86d04f-02ff-4a6e-8242-006872fc00cd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:09.355277 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fc86d04f-02ff-4a6e-8242-006872fc00cd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:09.393670 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['97759fc8-b7a8-4b8f-a577-a9edf94b1cc2']}} {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:09.425006 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '29e59226-6ca4-4d8a-8500-0fad2002cbfe') {'for_net_delete': True} {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:09.425424 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '29e59226-6ca4-4d8a-8500-0fad2002cbfe') {} {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:09.441754 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8730056711181', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2340933'] for segment, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:09.459033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:09.461604 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] Releasing vxlan tunnel 6 to pool {{(pid=84111) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:322}} Feb 17 18:08:09.538053 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fc86d04f-02ff-4a6e-8242-006872fc00cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:09.548389 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-266e89ba-1d90-49ac-a98a-68a39c1e42f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:09.561789 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc86d04f-02ff-4a6e-8242-006872fc00cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a474804-14ed-4fd6-a9c0-d5c8052031d4,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:09.566570 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fc86d04f-02ff-4a6e-8242-006872fc00cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:09.595338 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-fc86d04f-02ff-4a6e-8242-006872fc00cd admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:09.596454 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-fc86d04f-02ff-4a6e-8242-006872fc00cd admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9a474804-14ed-4fd6-a9c0-d5c8052031d4 HTTP/1.1" status: 204 len: 168 time: 0.7656457 Feb 17 18:08:09.624440 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Allocated IP 172.20.0.3 (1800276f-b949-479f-aed9-1f68503c0afc/454e1bd3-ed8a-471d-bca5-14fd752ac4a6/7dfcf56f-401e-4ede-aff5-62c1357fe33f) {{(pid=84112) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:08:09.751556 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-890d7e7d-a9d9-47d3-baa7-67d0b042a025 req-45e5580b-ff31-4f40-83da-c07a32a2b6a6 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 210 time: 0.0631263 Feb 17 18:08:09.755808 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] Network 97759fc8-b7a8-4b8f-a577-a9edf94b1cc2 has no segments {{(pid=84111) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:08:09.765724 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1547159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4125015'] for segment, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:09.826336 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-061ce35f-f91e-4045-96a0-4eeb94219de1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:09.958188 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks [] for port, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:09.967534 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] Network 97759fc8-b7a8-4b8f-a577-a9edf94b1cc2 has no segments {{(pid=84111) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: Traceback (most recent call last): Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: timer() Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: cb(*args, **kw) Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/common/utils.py", line 973, in wrapper Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: return func(*args, **kwargs) Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: self._notify() Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: self.callback(batched_events) Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: event.method(event) Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: segment_id)['aggregates'][0] Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: return f(self, *a, **k) Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: return self._get(url).json() Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: **kwargs) Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1131, in get Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: return self.request(url, 'GET', **kwargs) Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 802, in request Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: **endpoint_filter) Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 17 18:08:09.997000 dv-cinder-760194-3-iscsi neutron-server[84000]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 17 18:08:10.015343 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:10.054233 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-bb1d3735-f062-4684-b46e-34cefdf58de2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:10.113569 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853224169', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036854319422'] for network, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:10.120076 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:10.134170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Pushing event updated for resources: {'Port': ['ID=7dfcf56f-401e-4ede-aff5-62c1357fe33f,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:10.183108 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:10.187785 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:10.214712 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] Pushing event deleted for resources: {'Network': ['ID=97759fc8-b7a8-4b8f-a577-a9edf94b1cc2,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:10.223205 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:10.245975 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f0f7babf-e7a7-4625-9252-c5d312f2fab3 admin admin] 10.222.0.13 "DELETE /v2.0/networks/97759fc8-b7a8-4b8f-a577-a9edf94b1cc2 HTTP/1.1" status: 204 len: 168 time: 1.7987654 Feb 17 18:08:10.254904 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55852) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:10.310596 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63706d74-61aa-4be4-ad8e-5559c795c455 req-1b8de80d-bc08-4df9-9e47-677251a65f34 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:10.312634 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-63706d74-61aa-4be4-ad8e-5559c795c455 req-1b8de80d-bc08-4df9-9e47-677251a65f34 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.2006369 Feb 17 18:08:10.390258 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Network 1800276f-b949-479f-aed9-1f68503c0afc is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:08:10.397765 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:08:10.402699 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Received port after_create {{(pid=84112) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:08:10.446443 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_v2 [None req-3d11bf27-0b8f-4b20-97ac-ce7a95769862 admin admin] Deleting subnet a25652d0-de9d-4cf8-97c3-2c842fae4762 {{(pid=84112) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1041}} Feb 17 18:08:10.449800 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3d11bf27-0b8f-4b20-97ac-ce7a95769862 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:10.453041 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-63706d74-61aa-4be4-ad8e-5559c795c455 req-3fa9681c-0b16-45d4-ab5f-a4cd5b37ebf9 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1337259 Feb 17 18:08:10.498500 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875fae9e-ed13-47c9-9367-6e5bf24a85db req-91c73a0d-33f6-413b-a0fe-e498a278a966 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:10.504179 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-875fae9e-ed13-47c9-9367-6e5bf24a85db req-91c73a0d-33f6-413b-a0fe-e498a278a966 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 931 time: 0.1519907 Feb 17 18:08:10.515645 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3d11bf27-0b8f-4b20-97ac-ce7a95769862 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036852617770'] for subnet, precommit_delete_associations {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:10.601705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3d11bf27-0b8f-4b20-97ac-ce7a95769862 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1550982'] for subnet, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:10.625597 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-875fae9e-ed13-47c9-9367-6e5bf24a85db req-c1fbc408-f024-4e9c-8f8d-5282a574efea tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1153450 Feb 17 18:08:10.809429 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:10.809429 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:10.821501 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:10.996966 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-19963bf5-8da7-4b01-9cf8-48cb04f4e831 req-fcc79e20-d298-4279-b392-1f9f7336fe82 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 210 time: 0.0719495 Feb 17 18:08:10.997161 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.0495794 Feb 17 18:08:11.012479 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cda83b4-a61a-4195-829e-c94539474101 req-08f0c7be-0e8d-4b45-a82f-63782b128c0a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:11.014352 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-08f0c7be-0e8d-4b45-a82f-63782b128c0a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "GET /v2.0/networks?id=ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 200 len: 815 time: 0.3140306 Feb 17 18:08:11.031646 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Request body: {'port': {'device_id': '596a74f3-0846-461e-8720-0b7935f957ee', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:11.071252 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Request body: {'port': {'device_id': '4da5abf8-f53e-4899-800d-f4920eeb2fa4', 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4', 'admin_state_up': True, 'tenant_id': 'c2e8792284c348238cf9afdcae0c221e'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:11.651818 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:11.679055 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:11.721787 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Usage tracker for resource:port and tenant:c2e8792284c348238cf9afdcae0c221e is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:11.737340 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3d11bf27-0b8f-4b20-97ac-ce7a95769862 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853224802', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted--9223372036852540111', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete--9223372036850851564'] for subnet, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:11.741424 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Quota usage for port was recalculated. Used quota:2. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:11.796128 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-5beeacac-7293-4e3e-9979-982c545502e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:11.878015 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55920) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:11.880861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:11.906807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d11bf27-0b8f-4b20-97ac-ce7a95769862 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a25652d0-de9d-4cf8-97c3-2c842fae4762,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:11.912912 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7d7949-124e-46b3-81f7-269d6e1db121 req-765f9bd4-5ae9-4272-b5bc-8183c5e2d507 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:11.916811 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-da7d7949-124e-46b3-81f7-269d6e1db121 req-765f9bd4-5ae9-4272-b5bc-8183c5e2d507 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.2424250 Feb 17 18:08:11.952841 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3d11bf27-0b8f-4b20-97ac-ce7a95769862 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:11.980095 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa01897d-62cb-498d-a4f2-850fea025f2c req-84fc08d2-f4d8-43ff-a938-42faf06fb2ac tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:11.980095 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fa01897d-62cb-498d-a4f2-850fea025f2c req-84fc08d2-f4d8-43ff-a938-42faf06fb2ac tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 931 time: 0.2026117 Feb 17 18:08:12.010561 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Made reservation on behalf of c2e8792284c348238cf9afdcae0c221e for: {'port': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:08:12.017016 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:12.032255 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:12.051151 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fa01897d-62cb-498d-a4f2-850fea025f2c req-306fb1da-d4d4-40be-9bde-7f7d99f84d7c tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0592513 Feb 17 18:08:12.073256 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-da7d7949-124e-46b3-81f7-269d6e1db121 req-ce400365-78bd-437d-bdac-5b1541ba7333 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1487081 Feb 17 18:08:12.126210 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b95ff068-b7c6-4bdd-8ec1-ac644df1209e admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:12.127623 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3d11bf27-0b8f-4b20-97ac-ce7a95769862 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:12.162411 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3d11bf27-0b8f-4b20-97ac-ce7a95769862 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/a25652d0-de9d-4cf8-97c3-2c842fae4762 HTTP/1.1" status: 204 len: 168 time: 1.9039786 Feb 17 18:08:12.166264 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55936) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:12.189334 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-b95ff068-b7c6-4bdd-8ec1-ac644df1209e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:12.256384 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-b95ff068-b7c6-4bdd-8ec1-ac644df1209e admin admin] Usage tracker for resource:security_group_rule and tenant:5bdc84bf446d47e58530f2802dbd7964 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:12.260955 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-b95ff068-b7c6-4bdd-8ec1-ac644df1209e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:12.267253 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-b95ff068-b7c6-4bdd-8ec1-ac644df1209e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:12.339216 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-da2232eb-dda6-467a-b1c0-7681429b5592 req-834d28f9-e456-4c4f-8027-e0adc8ec7ece tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 210 time: 0.0656445 Feb 17 18:08:12.419339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1376323'] for network, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:12.624904 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1551647', 'neutron.services.segments.db._delete_segments_for_network-8730056716045'] for network, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:12.689785 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7dfcf56f-401e-4ede-aff5-62c1357fe33f {{(pid=84112) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:229}} Feb 17 18:08:12.698528 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Allocated IP 172.20.0.5 (ee1c48e9-8681-4765-bc5b-bc0215d911a4/e1b65f5a-677d-4368-874f-50623d3454b9/a1b6e84d-6b15-4d65-9ce7-f45f4a58e775) {{(pid=84112) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:08:12.751108 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2866144d-ebea-4fc7-a2ed-9a219704d84f']}} {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:12.764128 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '32fbfdee-001e-40c9-98e6-c86dfab2a3e8') {'for_net_delete': True} {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:12.764458 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '32fbfdee-001e-40c9-98e6-c86dfab2a3e8') {} {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:12.777222 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8730056711181', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2340933'] for segment, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:13.188313 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Notify callbacks [] for port, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:13.220590 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:13.223530 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:13.230782 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] Releasing vxlan tunnel 8 to pool {{(pid=84111) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:322}} Feb 17 18:08:13.430408 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b95ff068-b7c6-4bdd-8ec1-ac644df1209e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:13.451012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks [] for port, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:13.520754 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b95ff068-b7c6-4bdd-8ec1-ac644df1209e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:13.523595 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:13.534557 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:13.542323 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:13.588909 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] Network 2866144d-ebea-4fc7-a2ed-9a219704d84f has no segments {{(pid=84111) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:08:13.603695 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1547159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4125015'] for segment, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:13.683324 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Pushing event updated for resources: {'Port': ['ID=a1b6e84d-6b15-4d65-9ce7-f45f4a58e775,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:13.686792 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:13.702529 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-b95ff068-b7c6-4bdd-8ec1-ac644df1209e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5bdc84bf446d47e58530f2802dbd7964&name=default HTTP/1.1" status: 200 len: 2979 time: 1.8211050 Feb 17 18:08:13.706196 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 55956) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:13.721545 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b95ff068-b7c6-4bdd-8ec1-ac644df1209e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ab2f984-4008-4977-b5d8-076a33497d52,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:13.725420 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b95ff068-b7c6-4bdd-8ec1-ac644df1209e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:13.786010 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Network ee1c48e9-8681-4765-bc5b-bc0215d911a4 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:08:13.788185 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:08:13.790654 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Received port after_create {{(pid=84112) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:08:13.819476 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d583284a-0a40-4dab-a701-26456cf69b69 req-ee1c1b47-07f6-4cb0-beae-1168c54589b5 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:13.821701 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d583284a-0a40-4dab-a701-26456cf69b69 req-ee1c1b47-07f6-4cb0-beae-1168c54589b5 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.5760238 Feb 17 18:08:13.836039 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd9cbcab-9e3a-4d58-8de6-e85d31e04f1e req-56acc6e7-4c1f-4c7a-ac44-4d18ef4d5da9 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:13.837666 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bd9cbcab-9e3a-4d58-8de6-e85d31e04f1e req-56acc6e7-4c1f-4c7a-ac44-4d18ef4d5da9 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 931 time: 0.5870721 Feb 17 18:08:13.853752 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e510f92c-73de-4c49-afb1-46f3a9026af9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:13.890912 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] Network 2866144d-ebea-4fc7-a2ed-9a219704d84f has no segments {{(pid=84111) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:08:13.893934 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:13.894610 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:13.903732 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e510f92c-73de-4c49-afb1-46f3a9026af9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: Traceback (most recent call last): Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: timer() Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: cb(*args, **kw) Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/common/utils.py", line 973, in wrapper Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: return func(*args, **kwargs) Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: self._notify() Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: self.callback(batched_events) Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: event.method(event) Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: segment_id)['aggregates'][0] Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: return f(self, *a, **k) Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: return self._get(url).json() Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: **kwargs) Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1131, in get Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: return self.request(url, 'GET', **kwargs) Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 802, in request Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: **endpoint_filter) Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 17 18:08:13.921287 dv-cinder-760194-3-iscsi neutron-server[84000]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 17 18:08:14.005681 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.9467127 Feb 17 18:08:14.018981 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Request body: {'port': {'device_id': '4da5abf8-f53e-4899-800d-f4920eeb2fa4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:14.023840 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d583284a-0a40-4dab-a701-26456cf69b69 req-d1950bed-9feb-4c80-9d7a-55bd08690303 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1850038 Feb 17 18:08:14.047839 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bd9cbcab-9e3a-4d58-8de6-e85d31e04f1e req-65088398-df65-4474-a088-d5f4397a1400 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1974008 Feb 17 18:08:14.100552 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853224169', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036854319422'] for network, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:14.104712 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-96bd0939-828f-4321-a488-13e1ab104933 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:14.120119 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:14.131261 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] Pushing event deleted for resources: {'Network': ['ID=2866144d-ebea-4fc7-a2ed-9a219704d84f,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:14.135702 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:14.139397 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-0e3fb39d-91fb-4dbf-805f-4861020462d7 admin admin] 10.222.0.13 "DELETE /v2.0/networks/2866144d-ebea-4fc7-a2ed-9a219704d84f HTTP/1.1" status: 204 len: 168 time: 1.9699960 Feb 17 18:08:14.187691 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Transition to ACTIVE for port object 7dfcf56f-401e-4ede-aff5-62c1357fe33f will not be triggered until provisioned by entity L2. {{(pid=84112) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:08:14.199574 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:14.211908 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e510f92c-73de-4c49-afb1-46f3a9026af9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:14.222515 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3ed3b030-2886-46c2-b2f1-3a86369138c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:14.236352 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e510f92c-73de-4c49-afb1-46f3a9026af9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ab2f984-4008-4977-b5d8-076a33497d52,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:14.238808 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e510f92c-73de-4c49-afb1-46f3a9026af9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:14.246019 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:14.267121 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e967538c-8d26-4d3a-a3a1-231822004e05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:14.309384 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132c7def-b4f0-48ce-be02-40aaaea361d9 req-4138f601-3a3a-4742-9208-261e2b47ea73 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:14.311311 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-132c7def-b4f0-48ce-be02-40aaaea361d9 req-4138f601-3a3a-4742-9208-261e2b47ea73 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 931 time: 0.1295576 Feb 17 18:08:14.364740 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-132c7def-b4f0-48ce-be02-40aaaea361d9 req-cd114104-9ec3-4229-a2ed-90da93d082b4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461023 Feb 17 18:08:14.425487 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e510f92c-73de-4c49-afb1-46f3a9026af9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:14.426699 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e510f92c-73de-4c49-afb1-46f3a9026af9 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3ab2f984-4008-4977-b5d8-076a33497d52 HTTP/1.1" status: 204 len: 168 time: 0.7193358 Feb 17 18:08:14.467260 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Pushing event updated for resources: {'Port': ['ID=7dfcf56f-401e-4ede-aff5-62c1357fe33f,revision_number=2']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:14.471331 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:14.529488 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55976) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:14.613660 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-6f4c167f-2e81-4702-a223-634a8489a58b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=cff1e61c03254c2f845d1aaf38f39663&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0827134 Feb 17 18:08:14.614323 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55980) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:14.681670 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-5270a56e-765c-4192-9b6a-11572db2b5d8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:14.694554 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 55984) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:14.717977 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-5270a56e-765c-4192-9b6a-11572db2b5d8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:14.792330 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-5270a56e-765c-4192-9b6a-11572db2b5d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:14.797846 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f46aa90e-44d3-4da8-9001-5ebcac5a31e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:14.812288 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5270a56e-765c-4192-9b6a-11572db2b5d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=657effe1-5114-4024-831b-cb01b39f4720,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:14.829089 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-5270a56e-765c-4192-9b6a-11572db2b5d8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:14.832853 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-5270a56e-765c-4192-9b6a-11572db2b5d8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/657effe1-5114-4024-831b-cb01b39f4720 HTTP/1.1" status: 204 len: 168 time: 0.2149124 Feb 17 18:08:14.832853 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-5270a56e-765c-4192-9b6a-11572db2b5d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:15.081384 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ead0fb09-f252-4bcc-94a1-ea2c07236e48 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:15.118919 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Attempting to bind port 7dfcf56f-401e-4ede-aff5-62c1357fe33f on host hv-cinder-76019 for vnic_type normal with profile {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:08:15.119299 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Attempting to bind port 7dfcf56f-401e-4ede-aff5-62c1357fe33f by drivers openvswitch on host hv-cinder-76019 at level 0 using segments [{'id': 'a45af54e-2b36-4f06-9307-68aa94af437e', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '1800276f-b949-479f-aed9-1f68503c0afc'}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:08:15.119689 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Attempting to bind port 7dfcf56f-401e-4ede-aff5-62c1357fe33f on network 1800276f-b949-479f-aed9-1f68503c0afc {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:08:15.122150 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-ead0fb09-f252-4bcc-94a1-ea2c07236e48 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:15.129417 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-ead0fb09-f252-4bcc-94a1-ea2c07236e48 admin admin] Usage tracker for resource:security_group_rule and tenant:aaf11c709ba34a68af834384dc4185aa is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:15.131953 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Checking agent: {'id': '35b9bf9c-0314-48b9-bb29-ba3a04c8b13c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 18, 4, 47), 'started_at': datetime.datetime(2021, 2, 17, 18, 5, 17), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 7, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.34', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:08:15.132405 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Checking segment: {'id': 'a45af54e-2b36-4f06-9307-68aa94af437e', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '1800276f-b949-479f-aed9-1f68503c0afc'} for mappings: {} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:08:15.132817 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:15.133220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Bound using segment: {'id': 'a45af54e-2b36-4f06-9307-68aa94af437e', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '1800276f-b949-479f-aed9-1f68503c0afc'} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:08:15.133709 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Bound port: 7dfcf56f-401e-4ede-aff5-62c1357fe33f, host: hv-cinder-76019, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a45af54e-2b36-4f06-9307-68aa94af437e', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '1800276f-b949-479f-aed9-1f68503c0afc'}}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:08:15.134093 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:15.139584 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-ead0fb09-f252-4bcc-94a1-ea2c07236e48 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:15.151697 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-ead0fb09-f252-4bcc-94a1-ea2c07236e48 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:15.305593 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] For port 7dfcf56f-401e-4ede-aff5-62c1357fe33f, host hv-cinder-76019, cleared binding levels {{(pid=84112) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:08:15.343790 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ead0fb09-f252-4bcc-94a1-ea2c07236e48 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:15.410378 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] For port 7dfcf56f-401e-4ede-aff5-62c1357fe33f, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=7dfcf56f-401e-4ede-aff5-62c1357fe33f,segment=NetworkSegment(a45af54e-2b36-4f06-9307-68aa94af437e),segment_id=a45af54e-2b36-4f06-9307-68aa94af437e)] {{(pid=84112) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:08:15.422780 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 {{(pid=84112) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:229}} Feb 17 18:08:15.433775 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ead0fb09-f252-4bcc-94a1-ea2c07236e48 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:15.435059 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Notify callbacks [] for port, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:15.451460 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:15.550899 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Transition to ACTIVE for port object a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 will not be triggered until provisioned by entity L2. {{(pid=84112) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:08:15.551862 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-945e9639-1aeb-450a-a5b6-8633dabbe621 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:15.637119 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 56016) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:15.637937 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:15.721341 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-24519877-d70d-4886-832b-e889702a921c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:15.798133 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-ead0fb09-f252-4bcc-94a1-ea2c07236e48 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=aaf11c709ba34a68af834384dc4185aa&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1017182 Feb 17 18:08:15.801140 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 56020) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:15.804781 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ead0fb09-f252-4bcc-94a1-ea2c07236e48 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c96d042-b08f-4ec7-8a62-b6054566f891,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:15.812645 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ead0fb09-f252-4bcc-94a1-ea2c07236e48 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:15.867776 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Pushing event updated for resources: {'Port': ['ID=7dfcf56f-401e-4ede-aff5-62c1357fe33f,revision_number=3']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:15.893976 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.342s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:15.894567 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3de5f2d4-d599-4737-8344-cbb7d76a505d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.193s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:15.926084 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1f9249-4352-4d28-8c87-23e62b0787fc req-6782b333-112b-4ea8-a349-fac7eed64295 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:15.931093 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bc1f9249-4352-4d28-8c87-23e62b0787fc req-6782b333-112b-4ea8-a349-fac7eed64295 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 943 time: 0.5732882 Feb 17 18:08:15.940405 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d52edad-3bcb-4b8a-9af7-f05121b7e686 req-ef402031-2482-496d-9aac-de1e3d9875d0 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:15.942572 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4d52edad-3bcb-4b8a-9af7-f05121b7e686 req-ef402031-2482-496d-9aac-de1e3d9875d0 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.5182655 Feb 17 18:08:15.977214 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e8cfe5bf-7058-4303-86a6-fa8fa81a0233 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=75271f713312489cbb30f15604711e23&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3052938 Feb 17 18:08:15.985480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 56032) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:15.990934 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1db4e0d2-0784-4405-9ffc-4c5b30c96d84 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:16.063106 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Pushing event updated for resources: {'Port': ['ID=a1b6e84d-6b15-4d65-9ce7-f45f4a58e775,revision_number=2']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:16.087560 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1db4e0d2-0784-4405-9ffc-4c5b30c96d84 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:16.094362 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:16.103530 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:16.104276 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:16.105775 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] 10.222.0.70 "PUT /v2.0/ports/7dfcf56f-401e-4ede-aff5-62c1357fe33f HTTP/1.1" status: 200 len: 1157 time: 5.0903957 Feb 17 18:08:16.106816 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '596a74f3-0846-461e-8720-0b7935f957ee', 'tag': '7dfcf56f-401e-4ede-aff5-62c1357fe33f'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:08:16.132928 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4d52edad-3bcb-4b8a-9af7-f05121b7e686 req-66ce473d-917a-496d-8512-de4dc19566db tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1659989 Feb 17 18:08:16.168766 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bc1f9249-4352-4d28-8c87-23e62b0787fc req-eaff751b-64ab-441d-8424-089ba562b008 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2249329 Feb 17 18:08:16.243717 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1db4e0d2-0784-4405-9ffc-4c5b30c96d84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:16.250003 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1dcc82ac-d560-4581-a833-bf468a6da46b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:16.266415 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db4e0d2-0784-4405-9ffc-4c5b30c96d84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c96d042-b08f-4ec7-8a62-b6054566f891,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:16.272613 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1db4e0d2-0784-4405-9ffc-4c5b30c96d84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:16.287931 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1db4e0d2-0784-4405-9ffc-4c5b30c96d84 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:16.289963 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-1db4e0d2-0784-4405-9ffc-4c5b30c96d84 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/1c96d042-b08f-4ec7-8a62-b6054566f891 HTTP/1.1" status: 204 len: 168 time: 0.4869046 Feb 17 18:08:16.409623 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '596a74f3-0846-461e-8720-0b7935f957ee', 'tag': '7dfcf56f-401e-4ede-aff5-62c1357fe33f', 'status': 'completed', 'code': 200} Feb 17 18:08:16.428890 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ce11e85a-9628-457e-9d95-406e49f7356f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:16.456048 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4a2763-d513-4891-b13c-312cf2b2a652 req-ba7f8b21-c38a-4d44-b27e-8d92da1f7271 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:16.457836 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bd4a2763-d513-4891-b13c-312cf2b2a652 req-ba7f8b21-c38a-4d44-b27e-8d92da1f7271 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 943 time: 0.1350803 Feb 17 18:08:16.486701 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ce11e85a-9628-457e-9d95-406e49f7356f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:16.495692 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Attempting to bind port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:08:16.496094 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Attempting to bind port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 by drivers openvswitch on host hv-cinder-76019 at level 0 using segments [{'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:08:16.496474 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Attempting to bind port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 on network ee1c48e9-8681-4765-bc5b-bc0215d911a4 {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:08:16.512552 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Checking agent: {'id': '35b9bf9c-0314-48b9-bb29-ba3a04c8b13c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 18, 4, 47), 'started_at': datetime.datetime(2021, 2, 17, 18, 5, 17), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 7, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.34', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:08:16.514121 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Checking segment: {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'} for mappings: {} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:08:16.514694 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:16.515218 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Bound using segment: {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:08:16.515825 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Bound port: a1b6e84d-6b15-4d65-9ce7-f45f4a58e775, host: hv-cinder-76019, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'}}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:08:16.524442 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:16.528818 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bd4a2763-d513-4891-b13c-312cf2b2a652 req-69be89ca-de2f-4838-a69c-d73f574514f7 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632901 Feb 17 18:08:16.646894 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-695da50b-0847-4214-894f-96a13a13f375 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:16.649250 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-695da50b-0847-4214-894f-96a13a13f375 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=b1cf694474c0491d93d574af2b2bceeb&device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 1160 time: 0.4053137 Feb 17 18:08:16.746864 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-b6da43b3-2853-4a7d-ad85-76dc66fdcfd1 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=7dfcf56f-401e-4ede-aff5-62c1357fe33f HTTP/1.1" status: 200 len: 217 time: 0.0862703 Feb 17 18:08:16.753960 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] For port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775, host hv-cinder-76019, cleared binding levels {{(pid=84112) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:08:16.813456 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ce11e85a-9628-457e-9d95-406e49f7356f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:16.816377 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] For port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=a1b6e84d-6b15-4d65-9ce7-f45f4a58e775,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84112) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:08:16.821075 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3da7aea7-688f-4174-81c9-aa58c1913b07 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:16.839611 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce11e85a-9628-457e-9d95-406e49f7356f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b53e8546-be44-4956-8841-86ed4ffc500f,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:16.846912 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ce11e85a-9628-457e-9d95-406e49f7356f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:16.851599 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-bc5c20cd-5717-4cc7-913c-e42017388718 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:16.853377 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-bc5c20cd-5717-4cc7-913c-e42017388718 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=454e1bd3-ed8a-471d-bca5-14fd752ac4a6 HTTP/1.1" status: 200 len: 846 time: 0.0969191 Feb 17 18:08:16.854619 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ce11e85a-9628-457e-9d95-406e49f7356f admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:16.858232 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-ce11e85a-9628-457e-9d95-406e49f7356f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b53e8546-be44-4956-8841-86ed4ffc500f HTTP/1.1" status: 204 len: 168 time: 0.8500471 Feb 17 18:08:16.906115 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:16.927079 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fe2253b8-d6aa-4d57-a587-a783c87dc1aa service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:17.015581 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-9c43c290-4bf1-4d4c-808f-8f861734b640 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=1800276f-b949-479f-aed9-1f68503c0afc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1551304 Feb 17 18:08:17.260191 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Pushing event updated for resources: {'Port': ['ID=a1b6e84d-6b15-4d65-9ce7-f45f4a58e775,revision_number=3']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:17.265420 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.338s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:17.431540 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:17.432286 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:17.433825 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] 10.222.0.70 "PUT /v2.0/ports/a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 HTTP/1.1" status: 200 len: 1157 time: 3.4196920 Feb 17 18:08:17.435903 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-2d783eed-5158-4be1-871f-0dd0b9458845 service neutron] 10.222.0.70 "GET /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3903198 Feb 17 18:08:17.617449 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a43b75e-0018-478f-b306-7519ea48e255 req-5c5257a6-e1a7-458d-a667-7292dd883936 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:17.647282 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1a43b75e-0018-478f-b306-7519ea48e255 req-5c5257a6-e1a7-458d-a667-7292dd883936 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.2877750 Feb 17 18:08:17.671981 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:17.726494 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1a43b75e-0018-478f-b306-7519ea48e255 req-50f646aa-a8aa-4f99-a692-f892ec4d32f0 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0754240 Feb 17 18:08:17.740915 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d08125d0-0c5d-4e6c-a777-ac235d758308 req-ee3ae0a0-7391-4e6f-8ce8-209a2a1206d3 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:17.744174 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d08125d0-0c5d-4e6c-a777-ac235d758308 req-ee3ae0a0-7391-4e6f-8ce8-209a2a1206d3 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 943 time: 0.3390636 Feb 17 18:08:17.774850 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e5105b93-a186-440b-b5d8-3f1821e2b4e6 req-c493de04-9a28-446e-81d6-f1c5d6664766 service neutron] 10.222.0.70 "GET /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.3221312 Feb 17 18:08:17.797891 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cda83b4-a61a-4195-829e-c94539474101 req-006662cf-2530-4966-ad43-064139acc161 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:17.799508 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-006662cf-2530-4966-ad43-064139acc161 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 1160 time: 0.2445865 Feb 17 18:08:17.809986 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d08125d0-0c5d-4e6c-a777-ac235d758308 req-6ebfe185-fb29-489f-b636-7b7555ee848c tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0564985 Feb 17 18:08:17.888449 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-c0ae6467-4c38-466e-9e03-72195be6def3 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 HTTP/1.1" status: 200 len: 217 time: 0.0771976 Feb 17 18:08:18.040225 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device bb98aa49-1c81-4cea-99cf-f201d19cfdae up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:18.122219 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b60a05c3-12f3-4c0d-b1ae-6e017862f230 req-c6790951-df12-449f-b3a5-66492b5bccf1 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:18.130490 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b60a05c3-12f3-4c0d-b1ae-6e017862f230 req-c6790951-df12-449f-b3a5-66492b5bccf1 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 943 time: 0.1017718 Feb 17 18:08:18.222503 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b60a05c3-12f3-4c0d-b1ae-6e017862f230 req-54c9b7b6-1015-472e-b1a3-06c0147a8643 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909343 Feb 17 18:08:18.255778 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port bb98aa49-1c81-4cea-99cf-f201d19cfdae triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:18.256388 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:18.317094 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cda83b4-a61a-4195-829e-c94539474101 req-06a4d20f-1128-49a2-addd-94742f5c3730 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:18.318668 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-06a4d20f-1128-49a2-addd-94742f5c3730 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=e1b65f5a-677d-4368-874f-50623d3454b9 HTTP/1.1" status: 200 len: 855 time: 0.4099929 Feb 17 18:08:18.329388 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-126d040f-7cdc-4a79-9259-ec86ecea71bc req-bbbb2191-3c5b-4f20-801b-8b319e4d4af3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:18.331927 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-126d040f-7cdc-4a79-9259-ec86ecea71bc req-bbbb2191-3c5b-4f20-801b-8b319e4d4af3 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=b1cf694474c0491d93d574af2b2bceeb&device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 1160 time: 0.4245977 Feb 17 18:08:18.407060 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-3143b3e2-a4e5-466c-9ffc-6209253dcefa service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=ee1c48e9-8681-4765-bc5b-bc0215d911a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0740852 Feb 17 18:08:18.457722 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4da5abf8-f53e-4899-800d-f4920eeb2fa4', 'tag': 'a1b6e84d-6b15-4d65-9ce7-f45f4a58e775'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:08:18.556227 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4da5abf8-f53e-4899-800d-f4920eeb2fa4', 'tag': 'a1b6e84d-6b15-4d65-9ce7-f45f4a58e775', 'status': 'completed', 'code': 200} Feb 17 18:08:18.667274 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-126d040f-7cdc-4a79-9259-ec86ecea71bc req-3cb2e73e-a26d-47ff-9dd8-68971d737a97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:18.668999 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-126d040f-7cdc-4a79-9259-ec86ecea71bc req-3cb2e73e-a26d-47ff-9dd8-68971d737a97 service neutron] 10.222.0.70 "GET /v2.0/networks?id=1800276f-b949-479f-aed9-1f68503c0afc HTTP/1.1" status: 200 len: 900 time: 0.2988386 Feb 17 18:08:18.781363 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-126d040f-7cdc-4a79-9259-ec86ecea71bc req-5b1a2441-5794-46f0-b5fc-ca3d60b1690c service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=7dfcf56f-401e-4ede-aff5-62c1357fe33f HTTP/1.1" status: 200 len: 217 time: 0.0950139 Feb 17 18:08:18.790797 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-b22221a0-58a9-4b30-8851-57246940ff4a service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3211560 Feb 17 18:08:18.978840 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-126d040f-7cdc-4a79-9259-ec86ecea71bc req-6dbb282a-420f-49d3-95f2-b917acc04edb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:18.980492 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-126d040f-7cdc-4a79-9259-ec86ecea71bc req-6dbb282a-420f-49d3-95f2-b917acc04edb service neutron] 10.222.0.70 "GET /v2.0/subnets?id=454e1bd3-ed8a-471d-bca5-14fd752ac4a6 HTTP/1.1" status: 200 len: 846 time: 0.1793714 Feb 17 18:08:19.070085 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-126d040f-7cdc-4a79-9259-ec86ecea71bc req-a92aa41b-3aa2-496a-9ff7-a2971111bb2e service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=1800276f-b949-479f-aed9-1f68503c0afc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0717070 Feb 17 18:08:19.115843 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d2ce84d-87bb-42ba-be99-87c72349a2a4 req-d87f33e9-ef2d-4c4c-b82d-8dc8ceb79ce7 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:19.117575 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9d2ce84d-87bb-42ba-be99-87c72349a2a4 req-d87f33e9-ef2d-4c4c-b82d-8dc8ceb79ce7 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1998959 Feb 17 18:08:19.164898 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8cda83b4-a61a-4195-829e-c94539474101 req-a01dbba3-e31b-448a-a239-34b115308b17 service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.3141534 Feb 17 18:08:19.182270 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1227b849-1191-40b4-936c-32db7d51e44c req-459fd356-5920-45a7-8c17-f7ce9cff6057 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:19.184236 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1227b849-1191-40b4-936c-32db7d51e44c req-459fd356-5920-45a7-8c17-f7ce9cff6057 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 943 time: 0.1430988 Feb 17 18:08:19.193880 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9d2ce84d-87bb-42ba-be99-87c72349a2a4 req-af53f203-12bf-4fd0-94e8-3e60dea09255 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686803 Feb 17 18:08:19.265815 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-126d040f-7cdc-4a79-9259-ec86ecea71bc req-fc06e12c-dab7-4ccf-afbb-3b18402a4067 service neutron] 10.222.0.70 "GET /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1785705 Feb 17 18:08:19.268496 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1227b849-1191-40b4-936c-32db7d51e44c req-1e3fba78-ffd1-4a40-8b1e-bd6e1f716fab tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735738 Feb 17 18:08:19.546898 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-126d040f-7cdc-4a79-9259-ec86ecea71bc req-eccd9613-e0b4-45f4-bfce-64245a9c8683 service neutron] 10.222.0.70 "GET /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2570329 Feb 17 18:08:19.550161 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace56094-b22d-4b10-9003-ba1ff0d304a9 req-2aa7d1fd-a148-4464-9fa2-e1412106377a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:19.551413 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ace56094-b22d-4b10-9003-ba1ff0d304a9 req-2aa7d1fd-a148-4464-9fa2-e1412106377a service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 1160 time: 0.2591281 Feb 17 18:08:19.627157 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ed1e8b0-2b25-4110-b4c7-8a06c21c5f86 req-cb67477c-aedf-4254-89c8-8437a0d67090 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:19.628811 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5ed1e8b0-2b25-4110-b4c7-8a06c21c5f86 req-cb67477c-aedf-4254-89c8-8437a0d67090 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 943 time: 0.2032800 Feb 17 18:08:19.688234 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5ed1e8b0-2b25-4110-b4c7-8a06c21c5f86 req-cba357e1-595d-4504-8738-07eb9515ea17 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518076 Feb 17 18:08:19.691218 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df25d05b-2e6b-4862-a6cd-f3787cc8d491 req-c7e08088-90bb-40ef-bcd4-76b6612dbe72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:19.692624 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-df25d05b-2e6b-4862-a6cd-f3787cc8d491 req-c7e08088-90bb-40ef-bcd4-76b6612dbe72 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 1162 time: 0.1489370 Feb 17 18:08:19.710270 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace56094-b22d-4b10-9003-ba1ff0d304a9 req-b59f1b06-7881-406c-9fe5-e020353d8f3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:19.711886 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ace56094-b22d-4b10-9003-ba1ff0d304a9 req-b59f1b06-7881-406c-9fe5-e020353d8f3c service neutron] 10.222.0.70 "GET /v2.0/networks?id=ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 200 len: 909 time: 0.1515613 Feb 17 18:08:19.742696 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-df25d05b-2e6b-4862-a6cd-f3787cc8d491 req-f2554eab-db6c-429b-9804-67928774c0d3 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369430 Feb 17 18:08:19.798614 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ace56094-b22d-4b10-9003-ba1ff0d304a9 req-f5ab11d8-68a8-4298-999c-e019bef05b43 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 HTTP/1.1" status: 200 len: 217 time: 0.0685856 Feb 17 18:08:20.077893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace56094-b22d-4b10-9003-ba1ff0d304a9 req-2ca39d6a-b724-43ab-b70a-d966b18745b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:20.079501 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ace56094-b22d-4b10-9003-ba1ff0d304a9 req-2ca39d6a-b724-43ab-b70a-d966b18745b2 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=e1b65f5a-677d-4368-874f-50623d3454b9 HTTP/1.1" status: 200 len: 855 time: 0.0817211 Feb 17 18:08:20.135282 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.objects.ports [None req-76a99126-b1e3-458e-b1bb-4dd783c7b75c None None] Time-cost: Fetching 1 ports in 1 security groups {{(pid=84113) get_objects /opt/stack/neutron/neutron/objects/ports.py:431}} Feb 17 18:08:20.139923 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ace56094-b22d-4b10-9003-ba1ff0d304a9 req-0c8c292f-8b4c-4fb2-b59c-44a333fec66c service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=ee1c48e9-8681-4765-bc5b-bc0215d911a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0507100 Feb 17 18:08:20.297849 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ace56094-b22d-4b10-9003-ba1ff0d304a9 req-98cfd3af-4db9-4e4d-bb59-d192403e09d2 service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1448073 Feb 17 18:08:20.464446 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ace56094-b22d-4b10-9003-ba1ff0d304a9 req-19b0bf19-ff44-4179-a4ae-5a71a772ac36 service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1567867 Feb 17 18:08:20.530302 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b5dbbbc-74e4-4b63-a4ff-8679dd445200 req-aed55ea9-76a7-4709-9e9f-051bc65f3c9b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:20.532006 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5b5dbbbc-74e4-4b63-a4ff-8679dd445200 req-aed55ea9-76a7-4709-9e9f-051bc65f3c9b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1820927 Feb 17 18:08:20.539385 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e29592-fd57-4eb3-9ab2-1cca6232937d req-4be76ab2-6ad3-40d7-8405-b56700eb7aaa tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:20.540943 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e7e29592-fd57-4eb3-9ab2-1cca6232937d req-4be76ab2-6ad3-40d7-8405-b56700eb7aaa tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 943 time: 0.1331389 Feb 17 18:08:20.618386 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5b5dbbbc-74e4-4b63-a4ff-8679dd445200 req-5db03710-3881-482f-9737-ccf978c2cf0e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763831 Feb 17 18:08:20.626821 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e7e29592-fd57-4eb3-9ab2-1cca6232937d req-c795305f-a8fe-4697-90e3-1474e6a3840f tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695848 Feb 17 18:08:20.859682 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 56210) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:20.929965 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cec163e-4ebd-4f0f-bfc2-dfc00c150a7d req-934d6d36-ca7a-47c5-82e6-8c5e627f9d00 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:20.932120 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3cec163e-4ebd-4f0f-bfc2-dfc00c150a7d req-934d6d36-ca7a-47c5-82e6-8c5e627f9d00 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 943 time: 0.1087267 Feb 17 18:08:20.943766 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device bb98aa49-1c81-4cea-99cf-f201d19cfdae up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:20.995139 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3cec163e-4ebd-4f0f-bfc2-dfc00c150a7d req-8f023739-9e9d-4b50-9ab5-3912329bb0ed tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0564644 Feb 17 18:08:21.031652 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cc7ec5be-d95d-40bd-9c07-172c6d6936ee admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:21.052584 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-cc7ec5be-d95d-40bd-9c07-172c6d6936ee admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:21.059415 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-cc7ec5be-d95d-40bd-9c07-172c6d6936ee admin admin] Usage tracker for resource:security_group_rule and tenant:ae56cde768d54c7c96ac4fffc6032fe0 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:21.060075 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-cc7ec5be-d95d-40bd-9c07-172c6d6936ee admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:21.072887 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-cc7ec5be-d95d-40bd-9c07-172c6d6936ee admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:21.073032 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port bb98aa49-1c81-4cea-99cf-f201d19cfdae triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:21.073032 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:21.162219 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cc7ec5be-d95d-40bd-9c07-172c6d6936ee admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:21.197347 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-cc7ec5be-d95d-40bd-9c07-172c6d6936ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:21.202418 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 7dfcf56f-401e-4ede-aff5-62c1357fe33f up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:21.213102 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-855b9b01-6a7e-4528-a62c-23b3f5efef34 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:21.281096 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-cc7ec5be-d95d-40bd-9c07-172c6d6936ee admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ae56cde768d54c7c96ac4fffc6032fe0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4193046 Feb 17 18:08:21.282352 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc7ec5be-d95d-40bd-9c07-172c6d6936ee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c6dc258-d5e8-4f19-82cc-dce97a95f7c6,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:21.283648 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 56226) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:21.291736 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-cc7ec5be-d95d-40bd-9c07-172c6d6936ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:21.320814 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning for port 7dfcf56f-401e-4ede-aff5-62c1357fe33f completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:08:21.327575 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 7dfcf56f-401e-4ede-aff5-62c1357fe33f triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:21.327575 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:21.372619 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-31e5c19c-3152-4b8b-830e-8c70bdcb78d5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:21.422749 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-31e5c19c-3152-4b8b-830e-8c70bdcb78d5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:21.515962 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:21.517517 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-31e5c19c-3152-4b8b-830e-8c70bdcb78d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:21.522897 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0f6c4720-1131-411c-aeec-65359b42edbe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:21.544040 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31e5c19c-3152-4b8b-830e-8c70bdcb78d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c6dc258-d5e8-4f19-82cc-dce97a95f7c6,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:21.547945 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-31e5c19c-3152-4b8b-830e-8c70bdcb78d5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:21.548879 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-31e5c19c-3152-4b8b-830e-8c70bdcb78d5 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5c6dc258-d5e8-4f19-82cc-dce97a95f7c6 HTTP/1.1" status: 204 len: 168 time: 0.2640944 Feb 17 18:08:21.553571 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-31e5c19c-3152-4b8b-830e-8c70bdcb78d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:21.610385 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '596a74f3-0846-461e-8720-0b7935f957ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7dfcf56f-401e-4ede-aff5-62c1357fe33f'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:08:21.645509 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port 7dfcf56f-401e-4ede-aff5-62c1357fe33f, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=7dfcf56f-401e-4ede-aff5-62c1357fe33f,segment=NetworkSegment(a45af54e-2b36-4f06-9307-68aa94af437e),segment_id=a45af54e-2b36-4f06-9307-68aa94af437e)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:08:21.680720 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '596a74f3-0846-461e-8720-0b7935f957ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7dfcf56f-401e-4ede-aff5-62c1357fe33f', 'code': 200} Feb 17 18:08:21.683152 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:21.686082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:21.801095 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=7dfcf56f-401e-4ede-aff5-62c1357fe33f,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:21.805597 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:22.011650 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a3487bd-53c5-4f35-a7f1-86a08ff3de9b req-99dda078-0d42-45e1-8d65-88407156172e tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:22.013802 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0a3487bd-53c5-4f35-a7f1-86a08ff3de9b req-99dda078-0d42-45e1-8d65-88407156172e tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 945 time: 0.2034712 Feb 17 18:08:22.032204 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1636f41-fd6e-413c-8e2e-0f252b5340e6 req-26939574-acc8-47ac-ad21-b9643a955b60 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:22.033814 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e1636f41-fd6e-413c-8e2e-0f252b5340e6 req-26939574-acc8-47ac-ad21-b9643a955b60 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.2220228 Feb 17 18:08:22.064289 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a68c62-d310-43e5-a652-05848d66f157 req-e8f6efd1-7837-4d3a-a39c-ac5d5ff7c978 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:22.066260 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-40a68c62-d310-43e5-a652-05848d66f157 req-e8f6efd1-7837-4d3a-a39c-ac5d5ff7c978 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 1162 time: 0.0958877 Feb 17 18:08:22.112428 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0a3487bd-53c5-4f35-a7f1-86a08ff3de9b req-98dad4f3-681f-4009-aa80-a247296d63c5 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0893209 Feb 17 18:08:22.117717 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e1636f41-fd6e-413c-8e2e-0f252b5340e6 req-8a40b6e1-453a-45c6-bc00-e24c3381703c tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673058 Feb 17 18:08:22.119413 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-40a68c62-d310-43e5-a652-05848d66f157 req-21138c40-aeef-4ec7-85ef-099d354c8a47 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438099 Feb 17 18:08:22.309486 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de64994-4851-491f-a23a-35ee93d567c6 req-faf64952-3ca0-4361-aa4f-7eb747a2e511 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:22.311029 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4de64994-4851-491f-a23a-35ee93d567c6 req-faf64952-3ca0-4361-aa4f-7eb747a2e511 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 943 time: 0.0897725 Feb 17 18:08:22.358974 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4de64994-4851-491f-a23a-35ee93d567c6 req-3c198482-8193-46a9-b9c5-3e5efef935a8 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415027 Feb 17 18:08:22.546001 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d12566f-3d08-4975-a968-156953ffc0e1 req-81e376fe-17cc-4fa9-96b2-c6c2f76ab7bd tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:22.547595 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3d12566f-3d08-4975-a968-156953ffc0e1 req-81e376fe-17cc-4fa9-96b2-c6c2f76ab7bd tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0891206 Feb 17 18:08:22.601615 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3d12566f-3d08-4975-a968-156953ffc0e1 req-d2c612b8-10fb-4836-b4ae-8241fdfacbb3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471356 Feb 17 18:08:22.900088 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device bb98aa49-1c81-4cea-99cf-f201d19cfdae up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:22.977560 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port bb98aa49-1c81-4cea-99cf-f201d19cfdae triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:22.977980 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:23.109956 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:23.177078 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 56286) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:23.260657 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning for port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:08:23.266969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:23.267563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:23.420930 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e8e4a0-9c9a-4238-8746-6029cca81dbd req-164074b7-bf43-4a94-ba4a-d5d04478811d tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:23.422653 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c8e8e4a0-9c9a-4238-8746-6029cca81dbd req-164074b7-bf43-4a94-ba4a-d5d04478811d tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 945 time: 0.1474156 Feb 17 18:08:23.459977 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7d6b5f5e-3683-4149-891b-e2da4262ef81 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:23.498467 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-7d6b5f5e-3683-4149-891b-e2da4262ef81 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:23.506548 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-7d6b5f5e-3683-4149-891b-e2da4262ef81 admin admin] Usage tracker for resource:security_group_rule and tenant:1e32c6996732479ab2d532f9c224406f is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:23.516287 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-7d6b5f5e-3683-4149-891b-e2da4262ef81 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:23.531923 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-7d6b5f5e-3683-4149-891b-e2da4262ef81 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:23.534540 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:23.536103 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c8e8e4a0-9c9a-4238-8746-6029cca81dbd req-8b2ccdf6-e085-41d4-a95f-8fb07bb866f7 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1069026 Feb 17 18:08:23.666736 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=a1b6e84d-6b15-4d65-9ce7-f45f4a58e775,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:08:23.676312 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7d6b5f5e-3683-4149-891b-e2da4262ef81 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:23.682316 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4da5abf8-f53e-4899-800d-f4920eeb2fa4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1b6e84d-6b15-4d65-9ce7-f45f4a58e775'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:08:23.718034 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:23.719178 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 7dfcf56f-401e-4ede-aff5-62c1357fe33f up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:23.752006 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7d6b5f5e-3683-4149-891b-e2da4262ef81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:23.757847 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9c63ea37-b974-4ebe-9488-af3a174517f7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:23.764223 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:23.802709 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf942f16-6f6b-4017-ac53-f3cd1b72a613 req-dd2a1ab2-9e21-4586-8380-677129dd9a50 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:23.816089 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bf942f16-6f6b-4017-ac53-f3cd1b72a613 req-dd2a1ab2-9e21-4586-8380-677129dd9a50 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 945 time: 0.1950142 Feb 17 18:08:23.866103 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=a1b6e84d-6b15-4d65-9ce7-f45f4a58e775,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:23.870043 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:23.880035 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 7dfcf56f-401e-4ede-aff5-62c1357fe33f triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:23.880579 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:23.899899 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6b5f5e-3683-4149-891b-e2da4262ef81 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=95defc05-826f-4c95-952f-498608dc5e0f,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:23.913158 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bf942f16-6f6b-4017-ac53-f3cd1b72a613 req-b7f7bf3c-563a-4785-b59a-9e0be99bfade tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0922151 Feb 17 18:08:23.927471 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7d6b5f5e-3683-4149-891b-e2da4262ef81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:23.938756 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-7d6b5f5e-3683-4149-891b-e2da4262ef81 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1e32c6996732479ab2d532f9c224406f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7604501 Feb 17 18:08:23.941572 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 56312) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:23.957395 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4da5abf8-f53e-4899-800d-f4920eeb2fa4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1b6e84d-6b15-4d65-9ce7-f45f4a58e775', 'code': 200} Feb 17 18:08:24.039363 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-46423860-f062-4cea-80ba-80ea2f817b4c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:24.069023 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-46423860-f062-4cea-80ba-80ea2f817b4c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:24.163478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-46423860-f062-4cea-80ba-80ea2f817b4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:24.169190 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:24.186709 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46423860-f062-4cea-80ba-80ea2f817b4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95defc05-826f-4c95-952f-498608dc5e0f,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:24.190251 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-46423860-f062-4cea-80ba-80ea2f817b4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:24.263405 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-46423860-f062-4cea-80ba-80ea2f817b4c admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:24.265124 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-46423860-f062-4cea-80ba-80ea2f817b4c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/95defc05-826f-4c95-952f-498608dc5e0f HTTP/1.1" status: 204 len: 168 time: 0.3219814 Feb 17 18:08:24.296012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:24.305878 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f03241be-0f22-4a1b-abf3-ec7294ddd65f req-e8e5e6ea-397c-48d4-846b-7489b2ba3ed4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:24.307540 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f03241be-0f22-4a1b-abf3-ec7294ddd65f req-e8e5e6ea-397c-48d4-846b-7489b2ba3ed4 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 1162 time: 0.0939202 Feb 17 18:08:24.368118 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f03241be-0f22-4a1b-abf3-ec7294ddd65f req-0573a83c-d516-4dd5-af07-6c6d3d6ef51a service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432429 Feb 17 18:08:24.372024 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:24.372455 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:24.505971 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 7dfcf56f-401e-4ede-aff5-62c1357fe33f up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:24.584746 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 7dfcf56f-401e-4ede-aff5-62c1357fe33f triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:24.585393 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:24.799111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30e51a78-a67b-4458-ab38-fc8ab8321847 req-5b8c8d9e-7003-481d-b92a-400b64d882b9 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:24.800895 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-30e51a78-a67b-4458-ab38-fc8ab8321847 req-5b8c8d9e-7003-481d-b92a-400b64d882b9 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 945 time: 0.1171227 Feb 17 18:08:24.853812 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-30e51a78-a67b-4458-ab38-fc8ab8321847 req-109871ca-42bc-493c-b9be-1d6e826968e6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456381 Feb 17 18:08:25.134471 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-597975af-3c1a-427a-b4e9-69efe4e8cf1e req-04c8daf8-5a4a-42b4-9059-98b4ffe9392f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:25.137528 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-597975af-3c1a-427a-b4e9-69efe4e8cf1e req-04c8daf8-5a4a-42b4-9059-98b4ffe9392f service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 1162 time: 0.1133852 Feb 17 18:08:25.177394 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d018c5-1e5e-4fc1-a9ad-d455a61e34b9 req-0ddaa596-ed9b-435d-ab52-3b4eeb98ee8c tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:25.180978 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b3d018c5-1e5e-4fc1-a9ad-d455a61e34b9 req-0ddaa596-ed9b-435d-ab52-3b4eeb98ee8c tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1051819 Feb 17 18:08:25.257020 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b3d018c5-1e5e-4fc1-a9ad-d455a61e34b9 req-b04067ae-d321-418d-9cdd-1fe79b4d0fcf tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624478 Feb 17 18:08:25.326294 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-597975af-3c1a-427a-b4e9-69efe4e8cf1e req-8c31556e-6394-4fde-959f-3bec906824d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:25.328234 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-597975af-3c1a-427a-b4e9-69efe4e8cf1e req-8c31556e-6394-4fde-959f-3bec906824d6 service neutron] 10.222.0.70 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 913 time: 0.1780479 Feb 17 18:08:25.369389 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc61d00-8588-4cdf-ab26-71b558a0a185 req-94efe863-f8ce-43cd-8ad2-71d8e9c2d324 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:25.375134 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7bc61d00-8588-4cdf-ab26-71b558a0a185 req-94efe863-f8ce-43cd-8ad2-71d8e9c2d324 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 945 time: 0.1033266 Feb 17 18:08:25.424729 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-597975af-3c1a-427a-b4e9-69efe4e8cf1e req-cfb6f5ec-f87f-4bf0-b3e1-9747ff56c583 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c3de3799-da31-433f-9203-bfbce68f8d59 HTTP/1.1" status: 200 len: 217 time: 0.0865228 Feb 17 18:08:25.427786 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7bc61d00-8588-4cdf-ab26-71b558a0a185 req-1d15accc-55d7-4844-a69e-ca2385a161cb tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450125 Feb 17 18:08:25.501536 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-597975af-3c1a-427a-b4e9-69efe4e8cf1e req-c3201fb9-284b-49f8-a08c-807bb78e4d0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:25.503420 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-597975af-3c1a-427a-b4e9-69efe4e8cf1e req-c3201fb9-284b-49f8-a08c-807bb78e4d0b service neutron] 10.222.0.70 "GET /v2.0/subnets?id=c04f01da-1295-4b8a-95ae-46589cb07040 HTTP/1.1" status: 200 len: 859 time: 0.0717983 Feb 17 18:08:25.588234 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-597975af-3c1a-427a-b4e9-69efe4e8cf1e req-ea10de72-39a1-4f90-b1de-0d81a1037f9e service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4aaf4a03-4480-421f-bff4-f9814e969001&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0541894 Feb 17 18:08:25.734299 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-597975af-3c1a-427a-b4e9-69efe4e8cf1e req-3251e5de-36c0-4386-b6ea-e56b21910e89 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1449044 Feb 17 18:08:25.911324 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-597975af-3c1a-427a-b4e9-69efe4e8cf1e req-6848a1da-aa5c-4197-8c92-0d3ab95080b1 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1438203 Feb 17 18:08:26.301517 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:26.430609 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:26.431188 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:26.626374 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b938da8-8a82-4218-ac9d-797c3191614f req-6411a676-78e0-433e-8921-c7053f503b48 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:26.633042 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0b938da8-8a82-4218-ac9d-797c3191614f req-6411a676-78e0-433e-8921-c7053f503b48 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1870828 Feb 17 18:08:26.683691 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0b938da8-8a82-4218-ac9d-797c3191614f req-3043321f-d051-4232-9644-d3f0d72e6a3e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467770 Feb 17 18:08:26.909662 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dee3e69-6e48-4bf8-9a35-6bf3540c5bd0 req-269ec948-d808-4e68-a332-3b1423cb1ab7 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:26.917836 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6dee3e69-6e48-4bf8-9a35-6bf3540c5bd0 req-269ec948-d808-4e68-a332-3b1423cb1ab7 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 945 time: 0.1033366 Feb 17 18:08:27.029328 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6dee3e69-6e48-4bf8-9a35-6bf3540c5bd0 req-20eb4574-9b7a-44f0-adb4-3f8e326e60c6 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1104598 Feb 17 18:08:27.071822 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54806b0f-b737-4e62-8731-72393e265040 req-1644322b-fbfc-4687-9d1d-dfba3e9137ab tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:27.073765 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-54806b0f-b737-4e62-8731-72393e265040 req-1644322b-fbfc-4687-9d1d-dfba3e9137ab tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 945 time: 0.1123583 Feb 17 18:08:27.132940 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-54806b0f-b737-4e62-8731-72393e265040 req-759b7731-6e4d-41db-b1eb-cf46851272b9 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527284 Feb 17 18:08:27.906366 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-569c3613-255f-4cc6-ac1b-7b4d5699a057 req-4351860f-a5b7-487a-acd8-c866b01b9aea tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:27.907992 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-569c3613-255f-4cc6-ac1b-7b4d5699a057 req-4351860f-a5b7-487a-acd8-c866b01b9aea tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0888872 Feb 17 18:08:27.957702 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-569c3613-255f-4cc6-ac1b-7b4d5699a057 req-f574c26e-26ee-4959-86e8-ba1cfa659858 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424404 Feb 17 18:08:28.341956 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdfa6dd5-421a-4e95-a985-b4a172ff4e08 req-6a58a9f2-81c1-4aa7-a5b3-38241cf95504 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:28.343821 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cdfa6dd5-421a-4e95-a985-b4a172ff4e08 req-6a58a9f2-81c1-4aa7-a5b3-38241cf95504 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 945 time: 0.0875251 Feb 17 18:08:28.392971 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cdfa6dd5-421a-4e95-a985-b4a172ff4e08 req-78730f3f-9bd7-4026-9b17-2d76e9a7f467 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429153 Feb 17 18:08:28.719235 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-3474d00c-0ba3-4ba4-a522-a54a8157d09e tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:28.720028 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-3474d00c-0ba3-4ba4-a522-a54a8157d09e tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Synchronizing usage tracker for tenant:b1cf694474c0491d93d574af2b2bceeb on resource:port {{(pid=84112) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:08:28.757733 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-3474d00c-0ba3-4ba4-a522-a54a8157d09e tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Unset dirty status for tenant:b1cf694474c0491d93d574af2b2bceeb on resource:port {{(pid=84112) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:08:28.759188 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-3474d00c-0ba3-4ba4-a522-a54a8157d09e tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.70 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 945 time: 0.1294229 Feb 17 18:08:29.060341 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-f1325591-d4a2-47a8-bd5b-295058ffe14b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Deleting port 7dfcf56f-401e-4ede-aff5-62c1357fe33f {{(pid=84112) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:08:29.061090 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-f1325591-d4a2-47a8-bd5b-295058ffe14b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:29.166606 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94cdcba7-ef4c-498f-a9bb-1a80d2b04df0 req-568711d4-45a8-4b57-9569-a758083b1813 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:29.168249 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94cdcba7-ef4c-498f-a9bb-1a80d2b04df0 req-568711d4-45a8-4b57-9569-a758083b1813 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0915062 Feb 17 18:08:29.218066 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94cdcba7-ef4c-498f-a9bb-1a80d2b04df0 req-9f8229f9-6249-4ce5-b742-87dca8ee9bd3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429156 Feb 17 18:08:29.328938 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-f1325591-d4a2-47a8-bd5b-295058ffe14b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] For port 7dfcf56f-401e-4ede-aff5-62c1357fe33f, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=7dfcf56f-401e-4ede-aff5-62c1357fe33f,segment=NetworkSegment(a45af54e-2b36-4f06-9307-68aa94af437e),segment_id=a45af54e-2b36-4f06-9307-68aa94af437e)] {{(pid=84112) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:08:29.329340 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-f1325591-d4a2-47a8-bd5b-295058ffe14b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:29.462454 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-f1325591-d4a2-47a8-bd5b-295058ffe14b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Calling delete_port for 7dfcf56f-401e-4ede-aff5-62c1357fe33f owned by compute:nova {{(pid=84112) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:08:29.608385 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96600bd5-086c-4031-904e-8259895d8b00 req-56f60842-4edf-4ed3-acd0-535cf59557ac tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:29.611378 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-96600bd5-086c-4031-904e-8259895d8b00 req-56f60842-4edf-4ed3-acd0-535cf59557ac tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 945 time: 0.1039553 Feb 17 18:08:29.671179 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-96600bd5-086c-4031-904e-8259895d8b00 req-66366d11-7ef6-4c82-9612-b6b328216b16 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534606 Feb 17 18:08:29.677699 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-f1325591-d4a2-47a8-bd5b-295058ffe14b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:29.697317 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:29.797105 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1325591-d4a2-47a8-bd5b-295058ffe14b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Pushing event deleted for resources: {'Port': ['ID=7dfcf56f-401e-4ede-aff5-62c1357fe33f,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:29.799780 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f1325591-d4a2-47a8-bd5b-295058ffe14b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:29.915493 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-f1325591-d4a2-47a8-bd5b-295058ffe14b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] No DVR routers for this DVR port 7dfcf56f-401e-4ede-aff5-62c1357fe33f on host hv-cinder-76019 {{(pid=84112) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Feb 17 18:08:29.918911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-f1325591-d4a2-47a8-bd5b-295058ffe14b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:29.921832 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '596a74f3-0846-461e-8720-0b7935f957ee', 'name': 'network-vif-deleted', 'tag': '7dfcf56f-401e-4ede-aff5-62c1357fe33f'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:08:29.957846 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-734ed1d5-34d4-47d3-aaf2-5a1fa5fac1eb req-f1325591-d4a2-47a8-bd5b-295058ffe14b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.70 "DELETE /v2.0/ports/7dfcf56f-401e-4ede-aff5-62c1357fe33f HTTP/1.1" status: 204 len: 173 time: 1.1927562 Feb 17 18:08:31.959104 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '596a74f3-0846-461e-8720-0b7935f957ee', 'name': 'network-vif-deleted', 'tag': '7dfcf56f-401e-4ede-aff5-62c1357fe33f', 'status': 'completed', 'code': 200} Feb 17 18:08:31.971547 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 7dfcf56f-401e-4ede-aff5-62c1357fe33f no longer exists at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:08:32.016071 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] No Port match for: 7dfcf56f-401e-4ede-aff5-62c1357fe33f {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:08:32.016643 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 7dfcf56f-401e-4ede-aff5-62c1357fe33f not bound to the agent host hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:08:32.143708 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9c92016-bd32-4259-bf64-3cf549510392 req-1ec74e20-b603-4884-9f81-774a1d471d90 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:32.146005 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b9c92016-bd32-4259-bf64-3cf549510392 req-1ec74e20-b603-4884-9f81-774a1d471d90 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0959983 Feb 17 18:08:32.197848 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b9c92016-bd32-4259-bf64-3cf549510392 req-dab0cf0d-9b47-4144-a6bb-6a4a813c1790 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456393 Feb 17 18:08:32.372479 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cb9d765d-ff8f-4528-b2f0-2cfb078bac0c req-6610460c-1024-4004-854c-8be5e77ad948 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=596a74f3-0846-461e-8720-0b7935f957ee HTTP/1.1" status: 200 len: 210 time: 0.0541453 Feb 17 18:08:33.399972 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5247423-28a2-405a-a67a-eceb98bbc98e req-f320c425-15a3-46ac-be5e-c48a4970ffdb tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:33.401719 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c5247423-28a2-405a-a67a-eceb98bbc98e req-f320c425-15a3-46ac-be5e-c48a4970ffdb tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0895321 Feb 17 18:08:33.461980 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c5247423-28a2-405a-a67a-eceb98bbc98e req-5d80f62f-a9a8-4071-bc77-e167cf0ef9d9 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516441 Feb 17 18:08:33.838860 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-9682a4e4-c70d-4c4b-bfbf-1263946a0fb6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:33.840515 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-9682a4e4-c70d-4c4b-bfbf-1263946a0fb6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/networks?id=1800276f-b949-479f-aed9-1f68503c0afc HTTP/1.1" status: 200 len: 806 time: 0.1631436 Feb 17 18:08:33.856602 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-b3ac8b29-17a9-40e4-ade7-d132cce39a0d tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/quotas/b1cf694474c0491d93d574af2b2bceeb HTTP/1.1" status: 200 len: 375 time: 0.0099041 Feb 17 18:08:33.912103 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-8b9ded73-0d78-49f5-9d3d-b921dfbcea6c tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=b1cf694474c0491d93d574af2b2bceeb&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0499318 Feb 17 18:08:34.050372 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-7ba63fd6-f1e5-459c-bb86-1c9aea8377bd service neutron] 10.222.0.13 "GET /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1311860 Feb 17 18:08:34.401793 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-722dfa6f-deee-49e2-baf7-3f8bc63e5a1c service neutron] 10.222.0.13 "GET /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.3445995 Feb 17 18:08:34.756227 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d2a0b89f-81b3-417f-9418-7f92dfa88951 req-6b474e9f-cf52-494e-8d4b-84db1fc9c53d tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 210 time: 0.0881028 Feb 17 18:08:34.870440 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-576cd5bf-d079-4526-a219-953a99deffa4 req-1a25ce53-f35a-43e9-a8d4-4bb239860d4f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:34.872036 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-576cd5bf-d079-4526-a219-953a99deffa4 req-1a25ce53-f35a-43e9-a8d4-4bb239860d4f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0986331 Feb 17 18:08:34.921817 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-576cd5bf-d079-4526-a219-953a99deffa4 req-e8139e4a-5df8-4288-a0cd-2620ec14c376 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428915 Feb 17 18:08:35.039355 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 56662) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:35.178140 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 56670) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:35.256949 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6d399e8b-cd5d-4fcb-85b9-6462853856b9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.269396 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7f2eb1f0-375f-4842-b49d-9e45f6188360 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.290553 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-6d399e8b-cd5d-4fcb-85b9-6462853856b9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:35.293239 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-7f2eb1f0-375f-4842-b49d-9e45f6188360 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:35.298059 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-6d399e8b-cd5d-4fcb-85b9-6462853856b9 admin admin] Usage tracker for resource:security_group_rule and tenant:26915f82710846649b48c0ce62ada296 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:35.301157 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-7f2eb1f0-375f-4842-b49d-9e45f6188360 admin admin] Usage tracker for resource:security_group_rule and tenant:448e1689e27448c2a308ae2625d51fb8 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:35.303927 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-6d399e8b-cd5d-4fcb-85b9-6462853856b9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:35.306749 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-7f2eb1f0-375f-4842-b49d-9e45f6188360 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:35.314340 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-6d399e8b-cd5d-4fcb-85b9-6462853856b9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:35.316640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-7f2eb1f0-375f-4842-b49d-9e45f6188360 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:35.477214 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6d399e8b-cd5d-4fcb-85b9-6462853856b9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.479260 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7f2eb1f0-375f-4842-b49d-9e45f6188360 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.500140 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6d399e8b-cd5d-4fcb-85b9-6462853856b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.509547 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-264b5136-17a7-4334-8a45-503d9eeb2340 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:35.534978 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7f2eb1f0-375f-4842-b49d-9e45f6188360 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.562516 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-6d399e8b-cd5d-4fcb-85b9-6462853856b9 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=26915f82710846649b48c0ce62ada296&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5219646 Feb 17 18:08:35.565559 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 56682) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:35.576937 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d399e8b-cd5d-4fcb-85b9-6462853856b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd14e083-e7da-41dd-a7c2-be01eaab5c26,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:35.582355 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6d399e8b-cd5d-4fcb-85b9-6462853856b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:35.582880 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-228de6a7-a541-44e0-a0e2-ccfdeaa17f2c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.031s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:35.594867 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-7f2eb1f0-375f-4842-b49d-9e45f6188360 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=448e1689e27448c2a308ae2625d51fb8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4149365 Feb 17 18:08:35.597905 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 56686) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:35.631640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f2eb1f0-375f-4842-b49d-9e45f6188360 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3f05498-6edc-49ba-9c7f-5d9ea67a65d2,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:35.640988 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7f2eb1f0-375f-4842-b49d-9e45f6188360 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:35.675570 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c56a5671-d053-4729-89c2-d31a2d7df5be admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.682897 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9216da80-f412-4654-b2dd-a8efdde3f981 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.707462 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c56a5671-d053-4729-89c2-d31a2d7df5be admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.712761 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9216da80-f412-4654-b2dd-a8efdde3f981 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.787350 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c56a5671-d053-4729-89c2-d31a2d7df5be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.794589 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-4213fcd7-2c0e-4079-a91e-afb788667ebf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:35.809196 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c56a5671-d053-4729-89c2-d31a2d7df5be admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.810872 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c56a5671-d053-4729-89c2-d31a2d7df5be admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/fd14e083-e7da-41dd-a7c2-be01eaab5c26 HTTP/1.1" status: 204 len: 168 time: 0.2440147 Feb 17 18:08:35.817280 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9216da80-f412-4654-b2dd-a8efdde3f981 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.821011 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c56a5671-d053-4729-89c2-d31a2d7df5be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd14e083-e7da-41dd-a7c2-be01eaab5c26,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:35.827756 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c56a5671-d053-4729-89c2-d31a2d7df5be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:35.827989 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e50ca15b-10cd-4ecf-94a8-32b4087b8bc4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:35.857865 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9216da80-f412-4654-b2dd-a8efdde3f981 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3f05498-6edc-49ba-9c7f-5d9ea67a65d2,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:35.861137 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9216da80-f412-4654-b2dd-a8efdde3f981 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:35.863533 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 56698) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:35.870544 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9216da80-f412-4654-b2dd-a8efdde3f981 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:35.876523 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-9216da80-f412-4654-b2dd-a8efdde3f981 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f3f05498-6edc-49ba-9c7f-5d9ea67a65d2 HTTP/1.1" status: 204 len: 168 time: 0.2773147 Feb 17 18:08:35.973057 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0822978a-761e-459d-b310-4fdf72f6ef0e req-16b971c3-b4a3-41c5-9ddf-4c96c55b626f tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 210 time: 0.0709257 Feb 17 18:08:36.042259 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a018473c-c52d-4ce8-a03c-7b52c53713ba admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:36.068698 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-a018473c-c52d-4ce8-a03c-7b52c53713ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:36.073754 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-a018473c-c52d-4ce8-a03c-7b52c53713ba admin admin] Usage tracker for resource:security_group_rule and tenant:d942196b2cf543318facc088ef95af87 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:36.077359 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-a018473c-c52d-4ce8-a03c-7b52c53713ba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:36.084120 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-a018473c-c52d-4ce8-a03c-7b52c53713ba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:36.207276 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f0c1b61-3eca-4bb7-aece-0abb603a2702 req-3c3f9cc3-2ca8-402d-bb86-e56d120126df tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:36.207641 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a018473c-c52d-4ce8-a03c-7b52c53713ba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:36.219008 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1f0c1b61-3eca-4bb7-aece-0abb603a2702 req-3c3f9cc3-2ca8-402d-bb86-e56d120126df tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1359007 Feb 17 18:08:36.253108 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a018473c-c52d-4ce8-a03c-7b52c53713ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:36.278649 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1f0c1b61-3eca-4bb7-aece-0abb603a2702 req-5d7876d7-acd8-4043-a134-ad1d4714b3c0 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0615973 Feb 17 18:08:36.332402 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e62e1e7a-10c8-4e77-9798-516c18024bc9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:36.356252 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-a018473c-c52d-4ce8-a03c-7b52c53713ba admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d942196b2cf543318facc088ef95af87&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4914706 Feb 17 18:08:36.359087 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 56716) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:36.404278 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a018473c-c52d-4ce8-a03c-7b52c53713ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=10fda614-504b-4366-bab5-bf0ef7bd4802,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:36.410131 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a018473c-c52d-4ce8-a03c-7b52c53713ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:36.466938 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-be9e5756-165d-4df6-a05e-51cf7e8699d7 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:36.466938 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-be9e5756-165d-4df6-a05e-51cf7e8699d7 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.70 "GET /v2.0/networks?id=1800276f-b949-479f-aed9-1f68503c0afc HTTP/1.1" status: 200 len: 806 time: 0.2449651 Feb 17 18:08:36.469902 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-21e8d9f6-6521-42b2-b15c-426966387793 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:36.481410 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Request body: {'port': {'device_id': 'da2d8b28-dcf2-4089-aaa7-d97b809badec', 'network_id': '1800276f-b949-479f-aed9-1f68503c0afc', 'admin_state_up': True, 'tenant_id': 'b1cf694474c0491d93d574af2b2bceeb'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:36.502744 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-21e8d9f6-6521-42b2-b15c-426966387793 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:36.609059 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-21e8d9f6-6521-42b2-b15c-426966387793 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:36.614436 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-31e5c19c-3152-4b8b-830e-8c70bdcb78d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:36.637992 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21e8d9f6-6521-42b2-b15c-426966387793 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10fda614-504b-4366-bab5-bf0ef7bd4802,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:36.651419 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-21e8d9f6-6521-42b2-b15c-426966387793 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:36.652365 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-21e8d9f6-6521-42b2-b15c-426966387793 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:36.653617 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-21e8d9f6-6521-42b2-b15c-426966387793 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/10fda614-504b-4366-bab5-bf0ef7bd4802 HTTP/1.1" status: 204 len: 168 time: 0.2931838 Feb 17 18:08:36.682216 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 56728) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:36.690010 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:36.697568 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Usage tracker for resource:port and tenant:b1cf694474c0491d93d574af2b2bceeb is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:36.701198 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Quota usage for port was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:36.702388 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1c18d74d-f43f-4968-8638-4a9770cd973e admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:36.707473 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:36.720988 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-1c18d74d-f43f-4968-8638-4a9770cd973e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:36.723108 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-1c18d74d-f43f-4968-8638-4a9770cd973e admin admin] Usage tracker for resource:security_group_rule and tenant:5e265c5b27f8421b812e2703c54b6f86 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:36.726440 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-1c18d74d-f43f-4968-8638-4a9770cd973e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:36.732399 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-1c18d74d-f43f-4968-8638-4a9770cd973e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:36.769179 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Made reservation on behalf of b1cf694474c0491d93d574af2b2bceeb for: {'port': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:08:36.784529 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:36.836248 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1c18d74d-f43f-4968-8638-4a9770cd973e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:36.906231 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1c18d74d-f43f-4968-8638-4a9770cd973e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:36.916158 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1db4e0d2-0784-4405-9ffc-4c5b30c96d84 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:36.970383 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c18d74d-f43f-4968-8638-4a9770cd973e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=68f1c43e-ff53-4dae-8af2-429d6150d4ec,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:36.998788 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-1c18d74d-f43f-4968-8638-4a9770cd973e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5e265c5b27f8421b812e2703c54b6f86&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3153570 Feb 17 18:08:37.000009 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1c18d74d-f43f-4968-8638-4a9770cd973e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:37.000730 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 56746) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:37.106036 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9d9d4e94-4896-4c1f-8b37-d8727029723b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:37.145734 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9d9d4e94-4896-4c1f-8b37-d8727029723b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:37.193261 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 56750) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:37.221474 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Allocated IP 172.20.0.12 (1800276f-b949-479f-aed9-1f68503c0afc/454e1bd3-ed8a-471d-bca5-14fd752ac4a6/99cee46a-5a67-4591-9758-17595dab4c44) {{(pid=84112) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:08:37.244595 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bc85392d-18e5-4024-81cd-f3280055bf13 req-3568b65b-3125-487f-b3d1-9fe5ba961d63 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 210 time: 0.0619309 Feb 17 18:08:37.295231 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9d9d4e94-4896-4c1f-8b37-d8727029723b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:37.303493 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:37.325713 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d9d4e94-4896-4c1f-8b37-d8727029723b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=68f1c43e-ff53-4dae-8af2-429d6150d4ec,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:37.338065 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9d9d4e94-4896-4c1f-8b37-d8727029723b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:37.343918 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9d9d4e94-4896-4c1f-8b37-d8727029723b admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:37.345070 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-9d9d4e94-4896-4c1f-8b37-d8727029723b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/68f1c43e-ff53-4dae-8af2-429d6150d4ec HTTP/1.1" status: 204 len: 168 time: 0.3433249 Feb 17 18:08:37.419068 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1483897094-network', 'tenant_id': '5729c656e2c64606a663d6434a5c3973'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:37.432418 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:37.441698 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Usage tracker for resource:network and tenant:5729c656e2c64606a663d6434a5c3973 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:37.446959 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:37.457277 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:37.508611 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Made reservation on behalf of 5729c656e2c64606a663d6434a5c3973 for: {'network': 1} {{(pid=84112) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:08:37.513322 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for network, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:37.529403 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7cfbb35-f03a-4889-8665-b293f6637269 req-d26044a3-2111-4e84-a9dd-0c1e5cfe5478 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:37.529866 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:37.530979 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d7cfbb35-f03a-4889-8665-b293f6637269 req-d26044a3-2111-4e84-a9dd-0c1e5cfe5478 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0880973 Feb 17 18:08:37.560585 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks [] for port, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:37.564025 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:37.572084 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Usage tracker for resource:security_group_rule and tenant:5729c656e2c64606a663d6434a5c3973 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:37.576164 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:37.583619 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:37.613089 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d7cfbb35-f03a-4889-8665-b293f6637269 req-3aa14fff-adb6-4369-b33a-75bcbccb58e7 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748339 Feb 17 18:08:37.692877 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:37.711942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4e9fe0f2-59a6-4dbe-99d9-1c12a69c7d07 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:37.712129 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-5c24ffa6-1a3d-47a2-97bb-b5505469a256 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:37.850856 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:37.871751 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Pushing event updated for resources: {'Port': ['ID=99cee46a-5a67-4591-9758-17595dab4c44,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:37.877394 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:37.898658 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:37.910982 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c2701685-fa4e-4ecd-87f7-34a62421f744 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:37.949185 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] vxlan segment allocate from pool success with {'vxlan_vni': 6} {{(pid=84112) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:151}} Feb 17 18:08:37.972066 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d20c28cb-f883-4a6f-897a-3150a1a1bbfe,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:37.975086 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment--9223363306798059772', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:37.975523 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.segments_db [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Added segment 26bc7590-668d-4f62-883e-3f8e0fb997b0 of type vxlan for network 6755b14b-f6f6-43aa-a697-3921175c5230 Feb 17 18:08:37.984057 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:37.985137 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Network 1800276f-b949-479f-aed9-1f68503c0afc is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:08:37.987236 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:08:37.992968 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Received port after_create {{(pid=84112) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:08:38.059487 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback--9223363306798451111'] for network, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:38.077585 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:38.080991 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:38.081529 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:38.159384 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625'] for network, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:38.160847 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:38.161504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:38.167251 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:38.182330 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port c3de3799-da31-433f-9203-bfbce68f8d59 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:38.182758 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:38.239644 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6ba54be9-9bcf-436d-8b8b-9b4d48e2a0c6 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.7628684 Feb 17 18:08:38.256413 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Request body: {'port': {'device_id': 'da2d8b28-dcf2-4089-aaa7-d97b809badec', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:38.305736 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.1112554 Feb 17 18:08:38.309010 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 56782) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:38.315912 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Request body: {'subnet': {'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1483897094-subnet', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'ip_version': 4}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:38.323419 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:38.328202 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Pushing event updated for resources: {'Network': ['ID=6755b14b-f6f6-43aa-a697-3921175c5230,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:38.328700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Usage tracker for resource:subnet and tenant:5729c656e2c64606a663d6434a5c3973 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:38.331807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:38.336213 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a20e111c-c0f2-4fec-bb54-9b5673a8c676 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:38.344027 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Network 6755b14b-f6f6-43aa-a697-3921175c5230 details requested by agent ovs-agent-dv-cinder-760194-3-iscsi with host dv-cinder-760194-3-iscsi {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:08:38.358478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:38.419099 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Network 6755b14b-f6f6-43aa-a697-3921175c5230 details requested by agent ovs-agent-hv-cinder-76019 with host hv-cinder-76019 {{(pid=84113) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:234}} Feb 17 18:08:38.420793 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:38.458848 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Made reservation on behalf of 5729c656e2c64606a663d6434a5c3973 for: {'subnet': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:08:38.463698 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create--9223372036845088803'] for subnet, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:38.769420 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd70991-4763-4ed2-bbfe-eaf799c6ec6d req-9e8359d8-620d-4322-939b-2ee43c7c34bd tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:38.771463 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2fd70991-4763-4ed2-bbfe-eaf799c6ec6d req-9e8359d8-620d-4322-939b-2ee43c7c34bd tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 932 time: 0.3694353 Feb 17 18:08:38.860480 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2fd70991-4763-4ed2-bbfe-eaf799c6ec6d req-efacca68-600e-446c-87d2-99dfaf9ef4ed tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0794487 Feb 17 18:08:39.040156 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1996868e-7525-4b76-b569-5ddbd805ef06 req-014302aa-4d75-40b2-a779-1d7b18e9d33d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:39.041753 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1996868e-7525-4b76-b569-5ddbd805ef06 req-014302aa-4d75-40b2-a779-1d7b18e9d33d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1245251 Feb 17 18:08:39.114253 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1996868e-7525-4b76-b569-5ddbd805ef06 req-3f52652c-33d1-4d44-9131-a9a8330638bf tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0627217 Feb 17 18:08:39.116854 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:08:39.179626 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4126701', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create--9223372036845088820'] for subnet, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:39.196406 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d747ced5-b95b-47fe-b036-9b64744ac85f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:39.196657 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 99cee46a-5a67-4591-9758-17595dab4c44 {{(pid=84112) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:229}} Feb 17 18:08:39.205438 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Notify callbacks [] for port, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:39.220006 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Transition to ACTIVE for port object 99cee46a-5a67-4591-9758-17595dab4c44 will not be triggered until provisioned by entity L2. {{(pid=84112) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:08:39.266058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:39.285088 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:39.327215 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8a96f440-286f-407f-9d7e-b3b2727a69a9,revision_number=0']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:39.332717 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:39.402150 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Checking segment: {'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84111) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:08:39.402543 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Network hostable DHCP agents. Network: 6755b14b-f6f6-43aa-a697-3921175c5230, hostable agents: ['6594ca46-39b1-4ab0-b9ec-5e0912824e96'], hosted agents: [] {{(pid=84111) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:333}} Feb 17 18:08:39.440313 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Pushing event updated for resources: {'Port': ['ID=99cee46a-5a67-4591-9758-17595dab4c44,revision_number=2']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:39.445804 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:39.454196 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Network 6755b14b-f6f6-43aa-a697-3921175c5230 is scheduled to be hosted by DHCP agent 6594ca46-39b1-4ab0-b9ec-5e0912824e96 with binding_index 1 {{(pid=84111) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:232}} Feb 17 18:08:39.500070 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760194-3-iscsi, 6755b14b-f6f6-43aa-a697-3921175c5230) {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:08:39.512352 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:39.513005 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Notify callbacks [] for subnet, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:39.518988 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-997d2502-769b-4d12-a009-a0b4ae3f8d07 None None] Network 6755b14b-f6f6-43aa-a697-3921175c5230 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:08:39.582779 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.2724898 Feb 17 18:08:39.586997 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 56814) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:39.595940 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:39.609195 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:39.622395 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Usage tracker for resource:router and tenant:5729c656e2c64606a663d6434a5c3973 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:39.630861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:39.647931 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:39.690045 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Attempting to bind port 99cee46a-5a67-4591-9758-17595dab4c44 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:08:39.690427 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Attempting to bind port 99cee46a-5a67-4591-9758-17595dab4c44 by drivers openvswitch on host hv-cinder-76019 at level 0 using segments [{'id': 'a45af54e-2b36-4f06-9307-68aa94af437e', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '1800276f-b949-479f-aed9-1f68503c0afc'}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:08:39.690933 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Attempting to bind port 99cee46a-5a67-4591-9758-17595dab4c44 on network 1800276f-b949-479f-aed9-1f68503c0afc {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:08:39.695723 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-395995', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-5288'] for router, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:39.697090 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-395820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag--9223372036854319730', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request--9223372036853142595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider--9223372036854770544'] for router, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:39.698723 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Checking agent: {'id': '35b9bf9c-0314-48b9-bb29-ba3a04c8b13c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 18, 4, 47), 'started_at': datetime.datetime(2021, 2, 17, 18, 5, 17), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 8, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.34', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:08:39.699115 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Checking segment: {'id': 'a45af54e-2b36-4f06-9307-68aa94af437e', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '1800276f-b949-479f-aed9-1f68503c0afc'} for mappings: {} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84112) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:08:39.699992 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:39.700407 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Bound using segment: {'id': 'a45af54e-2b36-4f06-9307-68aa94af437e', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '1800276f-b949-479f-aed9-1f68503c0afc'} {{(pid=84112) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:08:39.701053 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Bound port: 99cee46a-5a67-4591-9758-17595dab4c44, host: hv-cinder-76019, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a45af54e-2b36-4f06-9307-68aa94af437e', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 7, 'network_id': '1800276f-b949-479f-aed9-1f68503c0afc'}}] {{(pid=84112) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:08:39.701657 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:39.718169 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:39.790822 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa801fd4f-d9d9-59b5-9186-1ec4edf3a9c6-6755b14b-f6f6-43aa-a697-3921175c5230', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'fixed_ips': [{'subnet_id': '8a96f440-286f-407f-9d7e-b3b2727a69a9'}]}} from dv-cinder-760194-3-iscsi. {{(pid=84113) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:267}} Feb 17 18:08:39.791736 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:39.808488 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] For port 99cee46a-5a67-4591-9758-17595dab4c44, host hv-cinder-76019, cleared binding levels {{(pid=84112) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:08:39.812516 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] For port 99cee46a-5a67-4591-9758-17595dab4c44, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=99cee46a-5a67-4591-9758-17595dab4c44,segment=NetworkSegment(a45af54e-2b36-4f06-9307-68aa94af437e),segment_id=a45af54e-2b36-4f06-9307-68aa94af437e)] {{(pid=84112) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:08:39.849283 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:39.866348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:40.017055 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-614e5b5a-db82-42c6-aef3-2f1de20d146a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:40.026257 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Pushing event updated for resources: {'Port': ['ID=99cee46a-5a67-4591-9758-17595dab4c44,revision_number=3']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:40.031661 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:40.085026 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:40.085705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:40.087176 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] 10.222.0.70 "PUT /v2.0/ports/99cee46a-5a67-4591-9758-17595dab4c44 HTTP/1.1" status: 200 len: 1158 time: 1.8377159 Feb 17 18:08:40.089548 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'da2d8b28-dcf2-4089-aaa7-d97b809badec', 'tag': '99cee46a-5a67-4591-9758-17595dab4c44'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:08:40.104316 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Allocated IP 172.20.0.2 (6755b14b-f6f6-43aa-a697-3921175c5230/8a96f440-286f-407f-9d7e-b3b2727a69a9/8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f) {{(pid=84113) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:08:40.142932 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration--9223372036854319563', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration--9223372036854379843', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider--9223372036854770557'] for router, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:40.210260 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 56830) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:40.270413 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-390e4d75-94ef-403f-8991-abce0b300218 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:40.274683 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-390e4d75-94ef-403f-8991-abce0b300218 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=b1cf694474c0491d93d574af2b2bceeb&device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 1161 time: 0.1066813 Feb 17 18:08:40.372678 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'da2d8b28-dcf2-4089-aaa7-d97b809badec', 'tag': '99cee46a-5a67-4591-9758-17595dab4c44', 'status': 'completed', 'code': 200} Feb 17 18:08:40.382462 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-1ce43d54-3a5b-418b-91b1-2f225205340b service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=99cee46a-5a67-4591-9758-17595dab4c44 HTTP/1.1" status: 200 len: 217 time: 0.0984898 Feb 17 18:08:40.465510 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0358c0ae-aa79-4c89-ba2e-1e0be5ad6879 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:40.478029 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-990926a6-6e47-4204-9497-5a3a25e5758a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:40.479657 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-990926a6-6e47-4204-9497-5a3a25e5758a service neutron] 10.222.0.70 "GET /v2.0/subnets?id=454e1bd3-ed8a-471d-bca5-14fd752ac4a6 HTTP/1.1" status: 200 len: 846 time: 0.0884058 Feb 17 18:08:40.542746 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-9fa2f8d2-6162-4ca6-8d16-bb9af1c48762 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=1800276f-b949-479f-aed9-1f68503c0afc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0480175 Feb 17 18:08:40.544767 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Notify callbacks [] for port, precommit_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:40.547283 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-0358c0ae-aa79-4c89-ba2e-1e0be5ad6879 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:40.556011 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a21261d-b5ba-452f-8a27-2f06a7f8263b req-84899c06-8bab-4d81-b7b0-ee7486fda448 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:40.556576 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Transition to ACTIVE for port object 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f will not be triggered until provisioned by entity L2. {{(pid=84113) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:08:40.557626 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8a21261d-b5ba-452f-8a27-2f06a7f8263b req-84899c06-8bab-4d81-b7b0-ee7486fda448 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 944 time: 0.4032774 Feb 17 18:08:40.561928 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-0358c0ae-aa79-4c89-ba2e-1e0be5ad6879 admin admin] Usage tracker for resource:security_group_rule and tenant:09924062e47a45a29f33bb2352f87ab5 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:40.568613 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-0358c0ae-aa79-4c89-ba2e-1e0be5ad6879 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:40.583993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Transition to ACTIVE for port object 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f will not be triggered until provisioned by entity DHCP. {{(pid=84113) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:08:40.604149 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-0358c0ae-aa79-4c89-ba2e-1e0be5ad6879 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:40.620598 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038'] for port, after_create {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:40.638294 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a652432c-347b-4c50-99d1-bd3f29df62d5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:40.700402 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-6f49f6e0-61f8-43ad-8b24-30a197fb32e4 service neutron] 10.222.0.70 "GET /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1492727 Feb 17 18:08:40.779075 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Pushing event updated for resources: {'Port': ['ID=8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f,revision_number=1']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:40.788602 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:40.851743 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Network 6755b14b-f6f6-43aa-a697-3921175c5230 is already hosted by enough agents. {{(pid=84113) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:08:40.853085 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Resources bound (agent type, host, resource id): {{(pid=84113) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:08:40.855433 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:40.856333 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Received port after_create {{(pid=84113) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:08:40.873491 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39e32c31-11dd-40eb-952c-bf5ba335d21f req-745b246b-b0c8-42bd-9bc9-703f868db7bc service neutron] 10.222.0.70 "GET /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1632714 Feb 17 18:08:40.918645 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Attempting to bind port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f on host dv-cinder-760194-3-iscsi for vnic_type normal with profile {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:08:40.918832 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8a21261d-b5ba-452f-8a27-2f06a7f8263b req-a2f0af81-721d-4f45-ad6e-2f112ea5e4ce tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3466692 Feb 17 18:08:40.919090 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Attempting to bind port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f by drivers openvswitch on host dv-cinder-760194-3-iscsi at level 0 using segments [{'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:08:40.919377 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Attempting to bind port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f on network 6755b14b-f6f6-43aa-a697-3921175c5230 {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:08:40.925729 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Checking agent: {'id': '3fdd9543-fb8c-4d73-992e-15dd132fbdf2', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760194-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'started_at': datetime.datetime(2021, 2, 17, 17, 58, 12), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 8, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760194-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.58', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:08:40.926156 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Checking segment: {'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84113) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:08:40.926607 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:40.927046 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Bound using segment: {'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:08:40.927703 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Bound port: 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f, host: dv-cinder-760194-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'}}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:08:40.928001 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:40.943901 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a62cb4a-c5cb-4058-999c-aa0a61be3eec req-7a8dd007-5310-4659-9c33-5bee6bed8736 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:40.951344 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5a62cb4a-c5cb-4058-999c-aa0a61be3eec req-7a8dd007-5310-4659-9c33-5bee6bed8736 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.4726119 Feb 17 18:08:41.034480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] For port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f, host dv-cinder-760194-3-iscsi, cleared binding levels {{(pid=84113) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:08:41.039346 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] For port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f, host dv-cinder-760194-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f,segment=NetworkSegment(26bc7590-668d-4f62-883e-3f8e0fb997b0),segment_id=26bc7590-668d-4f62-883e-3f8e0fb997b0)] {{(pid=84113) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:08:41.050292 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b975a1d2-53fd-4d2e-8608-79e440ef486e req-6af6e070-9afb-409b-8c72-6dc52faeeb3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:41.051943 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b975a1d2-53fd-4d2e-8608-79e440ef486e req-6af6e070-9afb-409b-8c72-6dc52faeeb3f service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=b1cf694474c0491d93d574af2b2bceeb&device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 1161 time: 0.0846429 Feb 17 18:08:41.072696 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:41.181230 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:41.211305 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5a62cb4a-c5cb-4058-999c-aa0a61be3eec req-26e1a7d9-10b9-4b65-858e-a3055da65239 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2590139 Feb 17 18:08:41.220006 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0358c0ae-aa79-4c89-ba2e-1e0be5ad6879 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:41.256275 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:41.273699 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b975a1d2-53fd-4d2e-8608-79e440ef486e req-4b617168-d2e5-43b4-95c5-7fdec901ed77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:41.275308 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b975a1d2-53fd-4d2e-8608-79e440ef486e req-4b617168-d2e5-43b4-95c5-7fdec901ed77 service neutron] 10.222.0.70 "GET /v2.0/networks?id=1800276f-b949-479f-aed9-1f68503c0afc HTTP/1.1" status: 200 len: 900 time: 0.2146821 Feb 17 18:08:41.293852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0358c0ae-aa79-4c89-ba2e-1e0be5ad6879 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:41.302852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fe0afacd-ab24-4362-b01b-17be25fbe108 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:41.310676 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:41.365446 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Pushing event updated for resources: {'Port': ['ID=8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f,revision_number=2']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:41.377930 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:41.409670 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b975a1d2-53fd-4d2e-8608-79e440ef486e req-bd2a9121-9b0d-4f34-9207-83b3a8e3147c service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=99cee46a-5a67-4591-9758-17595dab4c44 HTTP/1.1" status: 200 len: 217 time: 0.1015861 Feb 17 18:08:41.445612 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-0358c0ae-aa79-4c89-ba2e-1e0be5ad6879 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=09924062e47a45a29f33bb2352f87ab5&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2345850 Feb 17 18:08:41.455566 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 56852) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:41.458349 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0358c0ae-aa79-4c89-ba2e-1e0be5ad6879 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ef9dd95-c17b-4994-936d-25cb99f0a3ae,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:41.465231 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0358c0ae-aa79-4c89-ba2e-1e0be5ad6879 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:41.508754 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b975a1d2-53fd-4d2e-8608-79e440ef486e req-5c8a36b5-e1a0-4d97-a7cd-006a988aa1fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:41.516127 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b975a1d2-53fd-4d2e-8608-79e440ef486e req-5c8a36b5-e1a0-4d97-a7cd-006a988aa1fe service neutron] 10.222.0.70 "GET /v2.0/subnets?id=454e1bd3-ed8a-471d-bca5-14fd752ac4a6 HTTP/1.1" status: 200 len: 846 time: 0.0910423 Feb 17 18:08:41.605976 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b975a1d2-53fd-4d2e-8608-79e440ef486e req-30338b69-a1cb-4b51-9ddf-d5943509e858 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=1800276f-b949-479f-aed9-1f68503c0afc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0614719 Feb 17 18:08:41.625659 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ef1f3c2a-49ad-4d0b-ac57-12c3b9397897 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:41.676359 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ef1f3c2a-49ad-4d0b-ac57-12c3b9397897 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:41.770093 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b975a1d2-53fd-4d2e-8608-79e440ef486e req-b46f9d3d-4e80-4ed8-b467-d816dd185749 service neutron] 10.222.0.70 "GET /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1469545 Feb 17 18:08:41.805097 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Allocated IP 172.27.1.224 (68fd415f-8606-43f8-b4d1-98e6a9c9af94/1c895d8f-55ff-4bdb-a323-742172b9934e/fd31815c-e811-4884-b0eb-8ac1112bed3e) {{(pid=84111) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:08:41.965197 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b975a1d2-53fd-4d2e-8608-79e440ef486e req-93c4cdfe-7544-42e8-ba2f-60a0b81f57ca service neutron] 10.222.0.70 "GET /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1786382 Feb 17 18:08:41.989072 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Notify callbacks [] for port, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:42.005565 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ef1f3c2a-49ad-4d0b-ac57-12c3b9397897 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:42.009107 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7f2eb1f0-375f-4842-b49d-9e45f6188360 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:42.029939 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef1f3c2a-49ad-4d0b-ac57-12c3b9397897 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ef9dd95-c17b-4994-936d-25cb99f0a3ae,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:42.032783 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ef1f3c2a-49ad-4d0b-ac57-12c3b9397897 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:42.037331 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:42.061478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ef1f3c2a-49ad-4d0b-ac57-12c3b9397897 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:42.065665 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-ef1f3c2a-49ad-4d0b-ac57-12c3b9397897 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5ef9dd95-c17b-4994-936d-25cb99f0a3ae HTTP/1.1" status: 204 len: 168 time: 0.6041751 Feb 17 18:08:42.124523 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:42.152939 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f03a28da-8afc-4285-98f7-b4e9bd18a0f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:42.301253 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Pushing event updated for resources: {'Port': ['ID=fd31815c-e811-4884-b0eb-8ac1112bed3e,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:42.304552 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:42.366811 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc195ba9-d853-4669-9004-cd9fb6cce82a req-769fdd45-0d7c-42f5-8286-614d4623969c tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:42.370722 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cc195ba9-d853-4669-9004-cd9fb6cce82a req-769fdd45-0d7c-42f5-8286-614d4623969c tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 944 time: 0.2900391 Feb 17 18:08:42.451544 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 is already hosted by enough agents. {{(pid=84111) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:08:42.455967 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Resources bound (agent type, host, resource id): {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:08:42.458352 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Received port after_create {{(pid=84111) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:08:42.504325 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 56872) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:42.523768 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-277e6832-9d6f-40b7-acf8-1c9020d10fc7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:42.532967 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cc195ba9-d853-4669-9004-cd9fb6cce82a req-5f97e39f-6664-424b-ad0a-4f4e2271d3f5 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1282494 Feb 17 18:08:42.540394 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-277e6832-9d6f-40b7-acf8-1c9020d10fc7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:42.544919 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-277e6832-9d6f-40b7-acf8-1c9020d10fc7 admin admin] Usage tracker for resource:security_group_rule and tenant:71593937c9a44f5db922495a32f6e36d is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:42.548004 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-277e6832-9d6f-40b7-acf8-1c9020d10fc7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:42.565172 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-277e6832-9d6f-40b7-acf8-1c9020d10fc7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:42.715268 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8737eee-25e2-43c5-a31f-153f9e3101a7 req-9ab4b903-48fc-4ec9-8cd1-c80b994e6a4f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:42.735989 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-277e6832-9d6f-40b7-acf8-1c9020d10fc7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:42.736909 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a8737eee-25e2-43c5-a31f-153f9e3101a7 req-9ab4b903-48fc-4ec9-8cd1-c80b994e6a4f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.3805940 Feb 17 18:08:42.745586 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:42.774296 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-277e6832-9d6f-40b7-acf8-1c9020d10fc7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:42.784803 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-cc7ec5be-d95d-40bd-9c07-172c6d6936ee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:42.864806 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:42.868399 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a8737eee-25e2-43c5-a31f-153f9e3101a7 req-d303aa50-4086-4302-ab96-93598bf392a5 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1212108 Feb 17 18:08:42.888111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-277e6832-9d6f-40b7-acf8-1c9020d10fc7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cafbd3f6-89e8-4ab2-9145-fecd960c02bc,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:42.888111 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-277e6832-9d6f-40b7-acf8-1c9020d10fc7 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=71593937c9a44f5db922495a32f6e36d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3799171 Feb 17 18:08:42.888111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-277e6832-9d6f-40b7-acf8-1c9020d10fc7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:42.890890 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 56876) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:42.898449 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning for port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:08:43.029656 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e969b262-272d-45bb-9819-87508c48e8e3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:43.063726 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e969b262-272d-45bb-9819-87508c48e8e3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:43.108490 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad49124-2e40-4794-bb6c-97ce5dee4aa1 req-bdd1cea3-cabc-4a2b-bb96-8f19a9fbfaf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:43.110655 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bad49124-2e40-4794-bb6c-97ce5dee4aa1 req-bdd1cea3-cabc-4a2b-bb96-8f19a9fbfaf9 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 1162 time: 0.1757994 Feb 17 18:08:43.156705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48678001-8d1c-4466-b591-6989c67c63dd None None] Network 6755b14b-f6f6-43aa-a697-3921175c5230 requested from dv-cinder-760194-3-iscsi {{(pid=84113) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:200}} Feb 17 18:08:43.237397 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e969b262-272d-45bb-9819-87508c48e8e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:43.248934 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0ebf1c6b-bab5-46c5-ae01-41c9df9ed9ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:43.266721 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:43.279599 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e969b262-272d-45bb-9819-87508c48e8e3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:43.292430 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e969b262-272d-45bb-9819-87508c48e8e3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/cafbd3f6-89e8-4ab2-9145-fecd960c02bc HTTP/1.1" status: 204 len: 168 time: 0.3917372 Feb 17 18:08:43.301302 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e969b262-272d-45bb-9819-87508c48e8e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cafbd3f6-89e8-4ab2-9145-fecd960c02bc,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:43.314298 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e969b262-272d-45bb-9819-87508c48e8e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:43.348286 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-485e1849-fd7c-42f4-ba8a-e5b2691631bc req-d37e3d94-9a06-4a12-b8d3-481b9bc1863d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:43.351038 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-485e1849-fd7c-42f4-ba8a-e5b2691631bc req-d37e3d94-9a06-4a12-b8d3-481b9bc1863d service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 1162 time: 0.2321787 Feb 17 18:08:43.422635 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad49124-2e40-4794-bb6c-97ce5dee4aa1 req-f645b954-eb75-4b36-b821-ec9abde000dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:43.424388 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bad49124-2e40-4794-bb6c-97ce5dee4aa1 req-f645b954-eb75-4b36-b821-ec9abde000dd service neutron] 10.222.0.70 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 913 time: 0.2806382 Feb 17 18:08:43.457550 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54cb8945-0938-4e92-8d27-fd40d4e95bb3 None None] Provisioning for port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f completed by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:08:43.473337 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54cb8945-0938-4e92-8d27-fd40d4e95bb3 None None] Provisioning complete for port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:43.473805 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54cb8945-0938-4e92-8d27-fd40d4e95bb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:43.482593 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-485e1849-fd7c-42f4-ba8a-e5b2691631bc req-8ab3b52d-a191-4a5c-b0ed-9ef17019c978 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647664 Feb 17 18:08:43.517744 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bad49124-2e40-4794-bb6c-97ce5dee4aa1 req-6cdd93af-61f6-4d87-87aa-9b5bd77e5b17 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c3de3799-da31-433f-9203-bfbce68f8d59 HTTP/1.1" status: 200 len: 217 time: 0.0804601 Feb 17 18:08:43.674179 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54cb8945-0938-4e92-8d27-fd40d4e95bb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:43.731222 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54cb8945-0938-4e92-8d27-fd40d4e95bb3 None None] For port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f,segment=NetworkSegment(26bc7590-668d-4f62-883e-3f8e0fb997b0),segment_id=26bc7590-668d-4f62-883e-3f8e0fb997b0)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:08:43.811678 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad49124-2e40-4794-bb6c-97ce5dee4aa1 req-a5ec78c2-b47f-4823-ab49-a8c22855d6d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:43.813196 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bad49124-2e40-4794-bb6c-97ce5dee4aa1 req-a5ec78c2-b47f-4823-ab49-a8c22855d6d1 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=c04f01da-1295-4b8a-95ae-46589cb07040 HTTP/1.1" status: 200 len: 859 time: 0.1125243 Feb 17 18:08:43.877894 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54cb8945-0938-4e92-8d27-fd40d4e95bb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:43.879806 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-4a35fdfc-3d7d-4e63-a298-77456e578c9a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:43.890280 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bad49124-2e40-4794-bb6c-97ce5dee4aa1 req-51e14e30-0d75-4434-90f1-19fb508302cb service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4aaf4a03-4480-421f-bff4-f9814e969001&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0674334 Feb 17 18:08:44.022564 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-e6a8ea4e-e7f6-4338-b57d-e46f34fabf54 None None] Provisioning complete for port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:44.022988 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e6a8ea4e-e7f6-4338-b57d-e46f34fabf54 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:44.075675 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bad49124-2e40-4794-bb6c-97ce5dee4aa1 req-21261524-fe23-4d45-98d7-43cac8ca2802 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1723537 Feb 17 18:08:44.095291 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54cb8945-0938-4e92-8d27-fd40d4e95bb3 None None] Pushing event updated for resources: {'Port': ['ID=8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f,revision_number=3']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:44.100526 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54cb8945-0938-4e92-8d27-fd40d4e95bb3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:44.200244 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-24b99331-f1ee-4f8a-b1b7-318338b3bdeb tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:44.201855 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-24b99331-f1ee-4f8a-b1b7-318338b3bdeb tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/networks?id=ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 200 len: 815 time: 0.6115458 Feb 17 18:08:44.222818 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-29f7ed3e-445a-442c-a938-dcf67de8079c tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/quotas/c2e8792284c348238cf9afdcae0c221e HTTP/1.1" status: 200 len: 375 time: 0.0103340 Feb 17 18:08:44.294610 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bad49124-2e40-4794-bb6c-97ce5dee4aa1 req-2814af2c-7ba0-42ec-a039-86d98ef05bc5 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2084258 Feb 17 18:08:44.300408 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create--9223372036854379860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-456206'] for router, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:44.320065 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-7c475b55-54a2-4bb2-9c74-61b53b69d344 None None] Provisioning complete for port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:44.320605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7c475b55-54a2-4bb2-9c74-61b53b69d344 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:44.482006 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa678cc-7657-4afe-b6df-75666d84b92b req-c715fc34-74a0-4b06-9ec8-11eb42ecc084 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:44.483713 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7aa678cc-7657-4afe-b6df-75666d84b92b req-c715fc34-74a0-4b06-9ec8-11eb42ecc084 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 944 time: 0.5742860 Feb 17 18:08:44.574704 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-d743e94d-c0ec-4b45-8474-8cd0647c0013 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&fields=id HTTP/1.1" status: 200 len: 348 time: 0.3439026 Feb 17 18:08:44.582003 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7aa678cc-7657-4afe-b6df-75666d84b92b req-040dac8d-e6a6-4df4-b1b4-fcfef53be9e5 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0911238 Feb 17 18:08:44.606518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-d66c536b-1bea-4995-8a21-8aa4e4e26fe8 None None] Provisioning complete for port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:44.606953 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d66c536b-1bea-4995-8a21-8aa4e4e26fe8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:44.781087 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:44.810202 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-06b4f4ee-609d-4796-b727-32af971fcded service neutron] 10.222.0.13 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2250717 Feb 17 18:08:44.885031 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port 8e389f4f-dc7a-43d0-aeb5-d83e9d6fbb2f triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:44.885452 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:44.891808 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Router 742dfc39-339a-428f-8a3f-88d236afaaf4 is scheduled to L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b with binding_index 1 {{(pid=84111) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:214}} Feb 17 18:08:44.986086 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 99cee46a-5a67-4591-9758-17595dab4c44 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:45.180464 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning for port 99cee46a-5a67-4591-9758-17595dab4c44 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:08:45.186492 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 99cee46a-5a67-4591-9758-17595dab4c44 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:45.186915 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:45.212432 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-4bccdfe3-424c-415c-b702-7042ca3dbdad service neutron] 10.222.0.13 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.4012973 Feb 17 18:08:45.239130 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84111) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:08:45.252193 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ebee42-fe04-40bc-a1f1-c465d5f0943d req-9ce2c643-63a2-4db6-afae-0d513eae5734 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:45.253073 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Sync routers for ids ['742dfc39-339a-428f-8a3f-88d236afaaf4'] in dv-cinder-760194-3-iscsi {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:08:45.260430 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f5ebee42-fe04-40bc-a1f1-c465d5f0943d req-9ce2c643-63a2-4db6-afae-0d513eae5734 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1945939 Feb 17 18:08:45.273914 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Routers {'742dfc39-339a-428f-8a3f-88d236afaaf4'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:08:45.276220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:08:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['742dfc39-339a-428f-8a3f-88d236afaaf4'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:45.330959 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:45.335048 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f5ebee42-fe04-40bc-a1f1-c465d5f0943d req-181c5de6-ab05-4042-bd52-5380148a3fa7 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712674 Feb 17 18:08:45.335048 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Notify callbacks [] for router, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:45.339128 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 56930) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:45.348527 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 5.7603540 Feb 17 18:08:45.389314 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port 99cee46a-5a67-4591-9758-17595dab4c44, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=99cee46a-5a67-4591-9758-17595dab4c44,segment=NetworkSegment(a45af54e-2b36-4f06-9307-68aa94af437e),segment_id=a45af54e-2b36-4f06-9307-68aa94af437e)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:08:45.390729 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'da2d8b28-dcf2-4089-aaa7-d97b809badec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99cee46a-5a67-4591-9758-17595dab4c44'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:08:45.430336 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:45.433544 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:45.518268 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'da2d8b28-dcf2-4089-aaa7-d97b809badec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99cee46a-5a67-4591-9758-17595dab4c44', 'code': 200} Feb 17 18:08:45.519488 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:45.532005 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-46cf89c4-fafb-4713-9346-f57216eda540 req-8a1e354b-6278-4ad6-8ffe-9ef5b4c28ecb tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 210 time: 0.0943487 Feb 17 18:08:45.541181 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Set router 742dfc39-339a-428f-8a3f-88d236afaaf4 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:08:45.665005 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=99cee46a-5a67-4591-9758-17595dab4c44,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:45.680050 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:45.799260 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port c3de3799-da31-433f-9203-bfbce68f8d59 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:45.800145 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:45.912163 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb543f72-184f-40af-9ef6-6ec639775260 req-01ad9bf3-81db-4b61-a92e-7bd820a1e73e tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:45.921804 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cb543f72-184f-40af-9ef6-6ec639775260 req-01ad9bf3-81db-4b61-a92e-7bd820a1e73e tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 946 time: 0.1255229 Feb 17 18:08:45.978930 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cb543f72-184f-40af-9ef6-6ec639775260 req-cb12f09e-9486-4489-a605-365c9707ee2c tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558500 Feb 17 18:08:46.152603 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:08:42Z', 'revision_number': 3, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:41Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi'}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:46.157681 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Checking router: 742dfc39-339a-428f-8a3f-88d236afaaf4 for host: dv-cinder-760194-3-iscsi {{(pid=84114) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:08:46.158085 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Updating router 742dfc39-339a-428f-8a3f-88d236afaaf4 port fd31815c-e811-4884-b0eb-8ac1112bed3e binding host dv-cinder-760194-3-iscsi {{(pid=84114) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:208}} Feb 17 18:08:46.217405 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:46.263151 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f7e3c6-c11b-43cd-89a6-7c8e3c01e13b req-5b52c05a-e40e-4e75-9837-f23d0afe053f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:46.270686 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a5f7e3c6-c11b-43cd-89a6-7c8e3c01e13b req-5b52c05a-e40e-4e75-9837-f23d0afe053f service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 1163 time: 0.2674243 Feb 17 18:08:46.328252 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 99cee46a-5a67-4591-9758-17595dab4c44 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:46.334761 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a5f7e3c6-c11b-43cd-89a6-7c8e3c01e13b req-f9893b57-a55a-4d30-bfd3-8a90a79ca68b service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590091 Feb 17 18:08:46.523805 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 99cee46a-5a67-4591-9758-17595dab4c44 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:46.524256 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:46.788963 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:46.790109 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Notify callbacks [] for port, precommit_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:46.797201 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9bdad270-1da0-4588-bf03-748e808563d8 req-3a6ae6c0-6811-4d1d-b9a3-24aa105ebc12 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 210 time: 0.0691793 Feb 17 18:08:46.827069 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Transition to ACTIVE for port object fd31815c-e811-4884-b0eb-8ac1112bed3e will not be triggered until provisioned by entity L2. {{(pid=84114) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:08:46.830726 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61dcf93-8b8b-40aa-ba17-a6f6d7e8b8ee req-b532eeb6-e76e-4ce8-a146-1b77aecc32a3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:46.837457 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c61dcf93-8b8b-40aa-ba17-a6f6d7e8b8ee req-b532eeb6-e76e-4ce8-a146-1b77aecc32a3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.2714014 Feb 17 18:08:46.888841 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:46.904249 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c61dcf93-8b8b-40aa-ba17-a6f6d7e8b8ee req-a431f0c8-18d1-4ac4-bac8-b5558f9eb0bb tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0603359 Feb 17 18:08:46.908775 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port c3de3799-da31-433f-9203-bfbce68f8d59 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:46.909388 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:46.930541 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-44e460c8-90cf-47d4-ba7a-ad1cc5879a59 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:46.944201 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:47.310211 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89a50179-26ea-49bc-baf7-f7ce379a9923 req-2a43c328-eb54-45b2-9954-be8f7a887597 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:47.319475 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-89a50179-26ea-49bc-baf7-f7ce379a9923 req-2a43c328-eb54-45b2-9954-be8f7a887597 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 946 time: 0.1544423 Feb 17 18:08:47.343249 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Pushing event updated for resources: {'Port': ['ID=fd31815c-e811-4884-b0eb-8ac1112bed3e,revision_number=2']} {{(pid=84114) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:47.355112 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.355492 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.355926 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.356291 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.356795 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.357008 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.357371 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.357729 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.358090 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.358445 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.358807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.359175 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.359558 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.360142 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.360249 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.360732 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.361087 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.361574 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.361769 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.362111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.362488 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.362843 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.363197 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.363548 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84114) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:47.370224 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.440s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:47.401570 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-89a50179-26ea-49bc-baf7-f7ce379a9923 req-1eb2d06d-49d0-4cb8-a0d4-ee443b88e3bb tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804367 Feb 17 18:08:47.437670 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Allocated IP 172.20.0.1 (6755b14b-f6f6-43aa-a697-3921175c5230/8a96f440-286f-407f-9d7e-b3b2727a69a9/babc7f9f-a62e-4d31-9f66-a2e5ad339378) {{(pid=84112) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:08:47.445193 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Attempting to bind port fd31815c-e811-4884-b0eb-8ac1112bed3e on host dv-cinder-760194-3-iscsi for vnic_type normal with profile {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:08:47.445884 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Attempting to bind port fd31815c-e811-4884-b0eb-8ac1112bed3e by drivers openvswitch on host dv-cinder-760194-3-iscsi at level 0 using segments [{'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}] {{(pid=84114) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:08:47.446515 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Attempting to bind port fd31815c-e811-4884-b0eb-8ac1112bed3e on network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:08:47.452647 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Checking agent: {'id': '3fdd9543-fb8c-4d73-992e-15dd132fbdf2', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760194-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'started_at': datetime.datetime(2021, 2, 17, 17, 58, 12), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 8, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760194-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.58', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:08:47.453353 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Checking segment: {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84114) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:08:47.454004 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:47.454639 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Bound using segment: {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'} {{(pid=84114) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:08:47.455433 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Bound port: fd31815c-e811-4884-b0eb-8ac1112bed3e, host: dv-cinder-760194-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b5e97d06-6722-4de8-9658-658adc74c7b4', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}}] {{(pid=84114) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:08:47.456113 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:47.575289 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] For port fd31815c-e811-4884-b0eb-8ac1112bed3e, host dv-cinder-760194-3-iscsi, cleared binding levels {{(pid=84114) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:08:47.578617 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] For port fd31815c-e811-4884-b0eb-8ac1112bed3e, host dv-cinder-760194-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=fd31815c-e811-4884-b0eb-8ac1112bed3e,segment=NetworkSegment(b5e97d06-6722-4de8-9658-658adc74c7b4),segment_id=b5e97d06-6722-4de8-9658-658adc74c7b4)] {{(pid=84114) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:08:47.609408 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84114) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:47.638268 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:47.673361 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:47.744113 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dbe1faf-ca33-4c58-88a7-626cf5c67c2d req-cf73787a-8aa7-454f-8ae1-fc39403c970b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:47.745759 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6dbe1faf-ca33-4c58-88a7-626cf5c67c2d req-cf73787a-8aa7-454f-8ae1-fc39403c970b service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 1162 time: 0.1869614 Feb 17 18:08:47.746271 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 57004) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:47.757260 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Notify callbacks [] for port, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:47.858117 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84793373-f6bd-4aa5-ab46-8ba8616d2d1f req-151eb9da-0454-4204-80b7-55e4b14924c2 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:47.866618 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-84793373-f6bd-4aa5-ab46-8ba8616d2d1f req-151eb9da-0454-4204-80b7-55e4b14924c2 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.3265872 Feb 17 18:08:47.904327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-7b9747c2-a23c-4b38-878d-d9eb7655083d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:47.906128 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-7b9747c2-a23c-4b38-878d-d9eb7655083d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "GET /v2.0/networks?id=ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 200 len: 815 time: 0.2602482 Feb 17 18:08:47.920762 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Transition to ACTIVE for port object babc7f9f-a62e-4d31-9f66-a2e5ad339378 will not be triggered until provisioned by entity DHCP. {{(pid=84112) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:08:47.927021 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Request body: {'port': {'device_id': 'ce54bae9-f6d3-439f-b544-92e481dfd9dc', 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4', 'admin_state_up': True, 'tenant_id': 'c2e8792284c348238cf9afdcae0c221e'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:47.958457 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Pushing event updated for resources: {'Port': ['ID=fd31815c-e811-4884-b0eb-8ac1112bed3e,revision_number=3']} {{(pid=84114) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:47.963504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-021e9e7e-8e16-44ac-82aa-d1625e25a773 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.325s {{(pid=84114) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:47.965992 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f313fe01-91be-4966-bd68-267a1619103e admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:48.001190 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f313fe01-91be-4966-bd68-267a1619103e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:48.005286 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f313fe01-91be-4966-bd68-267a1619103e admin admin] Usage tracker for resource:security_group_rule and tenant:5c4570eb16544fedaf32126880fb00cf is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:48.008925 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f313fe01-91be-4966-bd68-267a1619103e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:48.014747 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f313fe01-91be-4966-bd68-267a1619103e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:48.043556 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Routers {'742dfc39-339a-428f-8a3f-88d236afaaf4'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:08:48.044431 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:08:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['742dfc39-339a-428f-8a3f-88d236afaaf4'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:48.082624 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dbe1faf-ca33-4c58-88a7-626cf5c67c2d req-259f6896-3bc6-47de-9373-340731f1d457 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:48.084876 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6dbe1faf-ca33-4c58-88a7-626cf5c67c2d req-259f6896-3bc6-47de-9373-340731f1d457 service neutron] 10.222.0.70 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 913 time: 0.3230760 Feb 17 18:08:48.125126 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:48.136656 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-84793373-f6bd-4aa5-ab46-8ba8616d2d1f req-1d9f01ae-4e1c-4a54-8414-e0afe6eb2b46 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2676055 Feb 17 18:08:48.149110 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Usage tracker for resource:port and tenant:c2e8792284c348238cf9afdcae0c221e is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:48.152759 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Quota usage for port was recalculated. Used quota:3. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:48.166747 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:48.171371 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1d76005b-2c25-4965-887a-0b9029efbeb9 req-05a4eb28-30cb-49af-83f5-a4682b9f6399 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 210 time: 0.0858738 Feb 17 18:08:48.181214 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:48.198095 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6dbe1faf-ca33-4c58-88a7-626cf5c67c2d req-eb61dae5-4059-41ef-a9d5-85da17cc319c service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c3de3799-da31-433f-9203-bfbce68f8d59 HTTP/1.1" status: 200 len: 217 time: 0.1039569 Feb 17 18:08:48.206209 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-4c16b422-47f8-4dcb-8a35-8483a73851c4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:48.243306 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Made reservation on behalf of c2e8792284c348238cf9afdcae0c221e for: {'port': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:08:48.249985 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] Set router 742dfc39-339a-428f-8a3f-88d236afaaf4 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:08:48.251442 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:48.503342 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dbe1faf-ca33-4c58-88a7-626cf5c67c2d req-bb7b1fd0-799f-497e-8ced-85a332e373df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:48.505485 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6dbe1faf-ca33-4c58-88a7-626cf5c67c2d req-bb7b1fd0-799f-497e-8ced-85a332e373df service neutron] 10.222.0.70 "GET /v2.0/subnets?id=c04f01da-1295-4b8a-95ae-46589cb07040 HTTP/1.1" status: 200 len: 859 time: 0.2626121 Feb 17 18:08:48.516654 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Pushing event updated for resources: {'Port': ['ID=babc7f9f-a62e-4d31-9f66-a2e5ad339378,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:48.520650 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f313fe01-91be-4966-bd68-267a1619103e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:48.567917 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:08:42Z', 'revision_number': 3, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi'}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:48.575216 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.575722 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.576345 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.576470 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.577182 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.577285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.578020 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.578020 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.578421 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.579153 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.579342 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.579734 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.580229 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.585673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.585673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.585673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.585673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.585673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.585673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.585673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.585673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.585673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.585673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.585673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:48.589550 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.383s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:48.592932 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a6f1e7f-69e6-4598-8a5e-0f8db7023f46 None None] The sync data for ids ['742dfc39-339a-428f-8a3f-88d236afaaf4'] in dv-cinder-760194-3-iscsi is: [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:08:42Z', 'revision_number': 3, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi'}] {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:08:48.602186 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Network 6755b14b-f6f6-43aa-a697-3921175c5230 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:08:48.608208 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f313fe01-91be-4966-bd68-267a1619103e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:48.615801 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:08:48.618266 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Received port after_create {{(pid=84112) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:08:48.655189 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-661383d2-2049-4bd2-8c0b-413578366979 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:48.666050 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6dbe1faf-ca33-4c58-88a7-626cf5c67c2d req-62cc2623-cb79-4198-8108-5143da249e67 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4aaf4a03-4480-421f-bff4-f9814e969001&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1342924 Feb 17 18:08:48.694739 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Allocated IP 172.20.0.7 (ee1c48e9-8681-4765-bc5b-bc0215d911a4/e1b65f5a-677d-4368-874f-50623d3454b9/75d0676f-fef4-4868-aa7b-f5dda8df8073) {{(pid=84111) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:08:48.706530 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create--9223372036854376681'] for router_interface, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:48.735501 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60788583-1aa1-44b6-ab47-466ef62d0a9c req-0e483ab6-1e4f-4d05-afa5-8d2cb1072781 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:48.744353 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-60788583-1aa1-44b6-ab47-466ef62d0a9c req-0e483ab6-1e4f-4d05-afa5-8d2cb1072781 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 946 time: 0.1898127 Feb 17 18:08:48.842357 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-60788583-1aa1-44b6-ab47-466ef62d0a9c req-20032f8e-a136-45b1-a104-ed43cafee618 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0966337 Feb 17 18:08:48.861242 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f313fe01-91be-4966-bd68-267a1619103e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5c4570eb16544fedaf32126880fb00cf&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1121440 Feb 17 18:08:48.861511 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 57020) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:48.866130 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f313fe01-91be-4966-bd68-267a1619103e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=10df9432-f729-4ade-b763-7dc744df81f7,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:48.869650 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f313fe01-91be-4966-bd68-267a1619103e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:48.947484 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6dbe1faf-ca33-4c58-88a7-626cf5c67c2d req-f79fa4c1-4c2e-4972-b9ea-c17d0f0aa5bb service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2328069 Feb 17 18:08:48.963091 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-8086ec7f-8d0b-4e24-a802-c3f4af0eb277 None None] Provisioning for port babc7f9f-a62e-4d31-9f66-a2e5ad339378 completed by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:08:48.970560 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-8086ec7f-8d0b-4e24-a802-c3f4af0eb277 None None] Provisioning complete for port babc7f9f-a62e-4d31-9f66-a2e5ad339378 triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:48.971137 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8086ec7f-8d0b-4e24-a802-c3f4af0eb277 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:49.048070 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-8086ec7f-8d0b-4e24-a802-c3f4af0eb277 None None] Port babc7f9f-a62e-4d31-9f66-a2e5ad339378 cannot update to ACTIVE because it is not bound. {{(pid=84113) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:332}} Feb 17 18:08:49.181686 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:49.238434 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6dbe1faf-ca33-4c58-88a7-626cf5c67c2d req-5cd7cad1-26dd-4e10-b5e5-822f0cb5a5e3 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2877123 Feb 17 18:08:49.517062 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-eb1549fb-236c-4c3f-ab2c-f288a24afdfb req-744bda39-1620-47b6-8e6c-63a82d26b0a1 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 210 time: 0.1088581 Feb 17 18:08:49.533860 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks [] for port, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:49.579441 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-db904c11-ac13-4c75-8c25-34087c3a52b3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:49.620798 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:49.625002 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-db904c11-ac13-4c75-8c25-34087c3a52b3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:49.629094 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Notify callbacks [] for port, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:49.660038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2235372'] for port, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:49.662893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:49.691369 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:49.715400 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c931a9c-3bad-4376-9afd-1a9388599f68 req-11de1b2d-e05d-4a68-99cb-1fcd9580e975 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:49.717382 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3c931a9c-3bad-4376-9afd-1a9388599f68 req-11de1b2d-e05d-4a68-99cb-1fcd9580e975 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.4001710 Feb 17 18:08:49.782933 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Pushing event updated for resources: {'Port': ['ID=babc7f9f-a62e-4d31-9f66-a2e5ad339378,revision_number=2']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:49.785676 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1681264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-399217'] for router_interface, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:49.859812 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Pushing event updated for resources: {'Port': ['ID=75d0676f-fef4-4868-aa7b-f5dda8df8073,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:49.866691 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:49.900951 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3c931a9c-3bad-4376-9afd-1a9388599f68 req-e6bb5b6b-40df-4a94-8236-c7d929656f98 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1146805 Feb 17 18:08:49.969852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Network ee1c48e9-8681-4765-bc5b-bc0215d911a4 is already hosted by enough agents. {{(pid=84111) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:08:49.971461 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Resources bound (agent type, host, resource id): {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:08:49.973584 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-db904c11-ac13-4c75-8c25-34087c3a52b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:49.978655 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Received port after_create {{(pid=84111) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:08:50.007047 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-06d99160-7143-4b48-abdb-5cd36cf27e91 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:50.037298 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db904c11-ac13-4c75-8c25-34087c3a52b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10df9432-f729-4ade-b763-7dc744df81f7,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:50.049233 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-db904c11-ac13-4c75-8c25-34087c3a52b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:50.049994 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.359s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:50.080816 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-db904c11-ac13-4c75-8c25-34087c3a52b3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:50.085081 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-db904c11-ac13-4c75-8c25-34087c3a52b3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/10df9432-f729-4ade-b763-7dc744df81f7 HTTP/1.1" status: 204 len: 168 time: 1.2175753 Feb 17 18:08:50.104859 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:50.105553 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:50.157984 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-20b5b389-4f8b-4aaa-8ade-bad13966ea6d tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2360356 Feb 17 18:08:50.174079 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Request body: {'port': {'device_id': 'ce54bae9-f6d3-439f-b544-92e481dfd9dc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:08:50.208162 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Network 6755b14b-f6f6-43aa-a697-3921175c5230 is already hosted by enough agents. {{(pid=84112) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:08:50.209999 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Resources bound (agent type, host, resource id): {{(pid=84112) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:08:50.384038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:50.454812 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Router 742dfc39-339a-428f-8a3f-88d236afaaf4 has already been hosted by L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b {{(pid=84112) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:130}} Feb 17 18:08:50.646256 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-d39aad9f-d58a-49c2-8e90-bb624aecac61 None None] Provisioning complete for port babc7f9f-a62e-4d31-9f66-a2e5ad339378 triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:50.648045 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d39aad9f-d58a-49c2-8e90-bb624aecac61 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:50.807765 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device fd31815c-e811-4884-b0eb-8ac1112bed3e up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:50.866506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-d39aad9f-d58a-49c2-8e90-bb624aecac61 None None] Port babc7f9f-a62e-4d31-9f66-a2e5ad339378 cannot update to ACTIVE because it is not bound. {{(pid=84113) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:332}} Feb 17 18:08:50.877221 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84112) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:08:50.903304 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-d436e9cd-e8e9-40ca-8ca4-e480c54226fe admin admin] 10.222.0.13 "PUT /v2.0/routers/742dfc39-339a-428f-8a3f-88d236afaaf4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5623441 Feb 17 18:08:50.921469 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning for port fd31815c-e811-4884-b0eb-8ac1112bed3e completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:08:50.933067 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port fd31815c-e811-4884-b0eb-8ac1112bed3e triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:50.933807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:50.956245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 57060) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:50.984711 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-eec37605-0f51-464b-b301-2369cec8f789 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:51.000941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-eec37605-0f51-464b-b301-2369cec8f789 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:08:51.012192 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-eec37605-0f51-464b-b301-2369cec8f789 admin admin] Usage tracker for resource:security_group_rule and tenant:938e9aa8dab14506b6e7904d167c3c9d is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:08:51.020694 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-eec37605-0f51-464b-b301-2369cec8f789 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:08:51.028871 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-eec37605-0f51-464b-b301-2369cec8f789 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:08:51.031588 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-016125a1-97d9-4d21-91c6-44594bfc3023 req-ebd2420d-2945-48c5-9562-0e683b706602 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:51.032401 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-016125a1-97d9-4d21-91c6-44594bfc3023 req-ebd2420d-2945-48c5-9562-0e683b706602 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Synchronizing usage tracker for tenant:c2e8792284c348238cf9afdcae0c221e on resource:port {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:08:51.073531 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a78ab4c3-4197-443f-8aa8-75d643885c4e req-36fb66e2-4b44-4b75-900d-b67ed6e27aee tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:51.075095 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a78ab4c3-4197-443f-8aa8-75d643885c4e req-36fb66e2-4b44-4b75-900d-b67ed6e27aee tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 946 time: 0.3712621 Feb 17 18:08:51.131369 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:51.150116 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a78ab4c3-4197-443f-8aa8-75d643885c4e req-9e13fe1c-eba1-4472-aea3-c2bd82941eab tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666847 Feb 17 18:08:51.150740 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] For port fd31815c-e811-4884-b0eb-8ac1112bed3e, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=fd31815c-e811-4884-b0eb-8ac1112bed3e,segment=NetworkSegment(b5e97d06-6722-4de8-9658-658adc74c7b4),segment_id=b5e97d06-6722-4de8-9658-658adc74c7b4)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:08:51.150913 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-016125a1-97d9-4d21-91c6-44594bfc3023 req-ebd2420d-2945-48c5-9562-0e683b706602 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Unset dirty status for tenant:c2e8792284c348238cf9afdcae0c221e on resource:port {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:08:51.152169 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-016125a1-97d9-4d21-91c6-44594bfc3023 req-ebd2420d-2945-48c5-9562-0e683b706602 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 931 time: 0.2693837 Feb 17 18:08:51.185794 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:51.187743 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:51.248379 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 75d0676f-fef4-4868-aa7b-f5dda8df8073 {{(pid=84111) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:229}} Feb 17 18:08:51.262908 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Notify callbacks [] for port, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:51.277449 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-eec37605-0f51-464b-b301-2369cec8f789 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:51.279026 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-016125a1-97d9-4d21-91c6-44594bfc3023 req-fc68a194-9813-4087-964e-61bb3a331c3f tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0900502 Feb 17 18:08:51.302036 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Transition to ACTIVE for port object 75d0676f-fef4-4868-aa7b-f5dda8df8073 will not be triggered until provisioned by entity L2. {{(pid=84111) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:08:51.311263 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Pushing event updated for resources: {'Port': ['ID=fd31815c-e811-4884-b0eb-8ac1112bed3e,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:51.311506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-eec37605-0f51-464b-b301-2369cec8f789 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:51.314724 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:51.322128 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ee79ad66-22b0-4812-a691-ea705599a0d1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:51.334474 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4125045'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:51.352721 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:51.361083 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eec37605-0f51-464b-b301-2369cec8f789 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=332311a4-b3a2-4ece-9993-92194a9590c7,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:51.367182 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-eec37605-0f51-464b-b301-2369cec8f789 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:51.388028 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-eec37605-0f51-464b-b301-2369cec8f789 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=938e9aa8dab14506b6e7904d167c3c9d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4296236 Feb 17 18:08:51.389886 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 57076) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:08:51.471632 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-74ebc7cc-dddf-47bd-94e4-68dd23e512c6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:51.510440 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-74ebc7cc-dddf-47bd-94e4-68dd23e512c6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:51.579904 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Pushing event updated for resources: {'Port': ['ID=75d0676f-fef4-4868-aa7b-f5dda8df8073,revision_number=2']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:51.617048 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.617455 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.617853 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.618244 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.618632 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.619018 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.619402 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.619784 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.620221 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.620605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.620985 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.621365 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.621793 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.622189 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.622553 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.622931 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.623308 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.623687 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.624094 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.624472 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.624862 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.625230 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.625607 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.625981 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:51.633807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:51.655220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-74ebc7cc-dddf-47bd-94e4-68dd23e512c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:51.665449 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e510f92c-73de-4c49-afb1-46f3a9026af9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:51.685746 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74ebc7cc-dddf-47bd-94e4-68dd23e512c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=332311a4-b3a2-4ece-9993-92194a9590c7,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:51.688343 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-74ebc7cc-dddf-47bd-94e4-68dd23e512c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:51.693497 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-74ebc7cc-dddf-47bd-94e4-68dd23e512c6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:51.695255 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-74ebc7cc-dddf-47bd-94e4-68dd23e512c6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/332311a4-b3a2-4ece-9993-92194a9590c7 HTTP/1.1" status: 204 len: 168 time: 0.3041496 Feb 17 18:08:51.747604 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab4641a-3b4e-4a43-8f47-79e18e636bfb req-798316fd-f0de-4e6a-9d5b-120b26a7619e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:51.757955 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9ab4641a-3b4e-4a43-8f47-79e18e636bfb req-798316fd-f0de-4e6a-9d5b-120b26a7619e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.3640509 Feb 17 18:08:51.806365 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Sync routers for ids ['742dfc39-339a-428f-8a3f-88d236afaaf4'] in dv-cinder-760194-3-iscsi {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:08:51.817738 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Routers {'742dfc39-339a-428f-8a3f-88d236afaaf4'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:08:51.818418 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:08:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['742dfc39-339a-428f-8a3f-88d236afaaf4'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:51.870275 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9ab4641a-3b4e-4a43-8f47-79e18e636bfb req-02fd0009-7827-4c72-8bf9-08a7115adbd3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1100950 Feb 17 18:08:51.902913 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Attempting to bind port 75d0676f-fef4-4868-aa7b-f5dda8df8073 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:08:51.903366 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Attempting to bind port 75d0676f-fef4-4868-aa7b-f5dda8df8073 by drivers openvswitch on host hv-cinder-76019 at level 0 using segments [{'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'}] {{(pid=84111) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:08:51.903744 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Attempting to bind port 75d0676f-fef4-4868-aa7b-f5dda8df8073 on network ee1c48e9-8681-4765-bc5b-bc0215d911a4 {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:08:51.910042 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Checking agent: {'id': '35b9bf9c-0314-48b9-bb29-ba3a04c8b13c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 18, 4, 47), 'started_at': datetime.datetime(2021, 2, 17, 18, 5, 17), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 8, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.34', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:08:51.915537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Checking segment: {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'} for mappings: {} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84111) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:08:51.915537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:51.915537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Bound using segment: {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'} {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:08:51.915537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Bound port: 75d0676f-fef4-4868-aa7b-f5dda8df8073, host: hv-cinder-76019, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dc9d9960-339b-4f6e-a3d3-9084931321b3', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 4, 'network_id': 'ee1c48e9-8681-4765-bc5b-bc0215d911a4'}}] {{(pid=84111) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:08:51.915537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:52.031809 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] For port 75d0676f-fef4-4868-aa7b-f5dda8df8073, host hv-cinder-76019, cleared binding levels {{(pid=84111) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:08:52.035261 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] For port 75d0676f-fef4-4868-aa7b-f5dda8df8073, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=75d0676f-fef4-4868-aa7b-f5dda8df8073,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84111) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:08:52.066443 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4125045'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:52.099600 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:52.309696 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Pushing event updated for resources: {'Port': ['ID=75d0676f-fef4-4868-aa7b-f5dda8df8073,revision_number=3']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:52.320244 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:52.340691 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:52.418715 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Set router 742dfc39-339a-428f-8a3f-88d236afaaf4 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:08:52.577083 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:52.577779 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:52.579449 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] 10.222.0.70 "PUT /v2.0/ports/75d0676f-fef4-4868-aa7b-f5dda8df8073 HTTP/1.1" status: 200 len: 1157 time: 2.4105866 Feb 17 18:08:52.580083 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ce54bae9-f6d3-439f-b544-92e481dfd9dc', 'tag': '75d0676f-fef4-4868-aa7b-f5dda8df8073'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:08:52.613910 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82005b1c-92c4-4673-9c4f-91622ced097d req-ddf77b6f-e5b8-4e01-8998-cc59a7fde85b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:52.622273 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-82005b1c-92c4-4673-9c4f-91622ced097d req-ddf77b6f-e5b8-4e01-8998-cc59a7fde85b tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 946 time: 0.2671459 Feb 17 18:08:52.748420 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-3d9af3f3-1961-4707-879a-c36abd35ecc2 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:52.749248 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-3d9af3f3-1961-4707-879a-c36abd35ecc2 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Synchronizing usage tracker for tenant:b1cf694474c0491d93d574af2b2bceeb on resource:port {{(pid=84112) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:08:52.788147 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device fd31815c-e811-4884-b0eb-8ac1112bed3e up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:52.794483 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-82005b1c-92c4-4673-9c4f-91622ced097d req-5087a2cd-20b7-408b-a890-b20f5881f6ce tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/security-groups?id=70055f11-c17a-47be-b4e0-6020a600ddc5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1713960 Feb 17 18:08:52.808596 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-3d9af3f3-1961-4707-879a-c36abd35ecc2 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Unset dirty status for tenant:b1cf694474c0491d93d574af2b2bceeb on resource:port {{(pid=84112) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:08:52.810036 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-3d9af3f3-1961-4707-879a-c36abd35ecc2 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.70 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 946 time: 0.3368392 Feb 17 18:08:52.850045 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-069fdc17-ff94-4055-a851-b90d492ef060 req-24d65b43-e92e-4e9e-9b3a-a0ad592a75ac tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:52.853905 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-069fdc17-ff94-4055-a851-b90d492ef060 req-24d65b43-e92e-4e9e-9b3a-a0ad592a75ac tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 943 time: 0.3445017 Feb 17 18:08:52.879320 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port c3de3799-da31-433f-9203-bfbce68f8d59 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:52.879754 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:52.926002 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ce54bae9-f6d3-439f-b544-92e481dfd9dc', 'tag': '75d0676f-fef4-4868-aa7b-f5dda8df8073', 'status': 'completed', 'code': 200} Feb 17 18:08:52.982479 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-b0114345-d2c8-4d77-977c-f617b2622e77 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Deleting port 99cee46a-5a67-4591-9758-17595dab4c44 {{(pid=84112) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:08:52.982479 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-b0114345-d2c8-4d77-977c-f617b2622e77 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:53.015368 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-069fdc17-ff94-4055-a851-b90d492ef060 req-d309f063-19dc-448c-9465-180447f62e07 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1531007 Feb 17 18:08:53.022907 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-91322214-85d4-41e0-8536-09b0ec85bfb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:53.024815 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-91322214-85d4-41e0-8536-09b0ec85bfb1 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 1160 time: 0.3581827 Feb 17 18:08:53.415098 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port fd31815c-e811-4884-b0eb-8ac1112bed3e triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:53.416359 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:53.535118 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-b0114345-d2c8-4d77-977c-f617b2622e77 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] For port 99cee46a-5a67-4591-9758-17595dab4c44, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=99cee46a-5a67-4591-9758-17595dab4c44,segment=NetworkSegment(a45af54e-2b36-4f06-9307-68aa94af437e),segment_id=a45af54e-2b36-4f06-9307-68aa94af437e)] {{(pid=84112) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:08:53.535558 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-b0114345-d2c8-4d77-977c-f617b2622e77 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:53.635258 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-652ec5f0-823d-4322-9f90-48b0a7f0c4fa service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=75d0676f-fef4-4868-aa7b-f5dda8df8073 HTTP/1.1" status: 200 len: 217 time: 0.5968304 Feb 17 18:08:53.746170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-b0114345-d2c8-4d77-977c-f617b2622e77 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Calling delete_port for 99cee46a-5a67-4591-9758-17595dab4c44 owned by compute:nova {{(pid=84112) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:08:53.781625 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-b351f76b-3071-4fc8-88ab-5271968f13cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:53.783215 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-b351f76b-3071-4fc8-88ab-5271968f13cc service neutron] 10.222.0.70 "GET /v2.0/subnets?id=e1b65f5a-677d-4368-874f-50623d3454b9 HTTP/1.1" status: 200 len: 855 time: 0.1302314 Feb 17 18:08:53.874021 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184ac3d4-94a8-4a4c-ab1f-c81d993075ac req-8c609215-774f-48f4-a9f6-00921ad6b3c8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:53.876598 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-184ac3d4-94a8-4a4c-ab1f-c81d993075ac req-8c609215-774f-48f4-a9f6-00921ad6b3c8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.7452443 Feb 17 18:08:53.879351 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-5ea8d816-1a69-4478-8491-cb5872afadd5 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=ee1c48e9-8681-4765-bc5b-bc0215d911a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0863731 Feb 17 18:08:53.917598 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:08:48Z', 'revision_number': 4, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': 'babc7f9f-a62e-4d31-9f66-a2e5ad339378', 'name': '', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'mac_address': 'fa:16:3e:6a:c4:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:47Z', 'updated_at': '2021-02-17T18:08:49Z', 'revision_number': 2, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'subnets': [{'id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:53.922594 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Checking router: 742dfc39-339a-428f-8a3f-88d236afaaf4 for host: dv-cinder-760194-3-iscsi {{(pid=84113) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:08:53.923020 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Updating router 742dfc39-339a-428f-8a3f-88d236afaaf4 port babc7f9f-a62e-4d31-9f66-a2e5ad339378 binding host dv-cinder-760194-3-iscsi {{(pid=84113) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:208}} Feb 17 18:08:53.989372 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:54.158065 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-184ac3d4-94a8-4a4c-ab1f-c81d993075ac req-86024914-37fe-4c63-99ad-375499037edb tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2692225 Feb 17 18:08:54.237421 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-b0114345-d2c8-4d77-977c-f617b2622e77 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:54.308315 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-548c59ac-eb7a-4f1e-8661-363d3cb1b838 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:54.311892 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-b05621f5-4e06-46a7-96ee-1a075f6068c1 service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3780265 Feb 17 18:08:54.322009 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 99cee46a-5a67-4591-9758-17595dab4c44 no longer exists at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:08:54.405213 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] No Port match for: 99cee46a-5a67-4591-9758-17595dab4c44 {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:08:54.405606 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 99cee46a-5a67-4591-9758-17595dab4c44 not bound to the agent host hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:08:54.524768 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0114345-d2c8-4d77-977c-f617b2622e77 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Pushing event deleted for resources: {'Port': ['ID=99cee46a-5a67-4591-9758-17595dab4c44,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:54.535245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b0114345-d2c8-4d77-977c-f617b2622e77 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:54.669831 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6be85cc4-834e-49cb-9230-f952ca1bfac2 req-c20850d7-549b-4c5f-a6a3-59db44e76659 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 210 time: 0.3026767 Feb 17 18:08:54.760490 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-b0114345-d2c8-4d77-977c-f617b2622e77 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] No DVR routers for this DVR port 99cee46a-5a67-4591-9758-17595dab4c44 on host hv-cinder-76019 {{(pid=84112) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Feb 17 18:08:54.764615 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-b0114345-d2c8-4d77-977c-f617b2622e77 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:54.775021 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'da2d8b28-dcf2-4089-aaa7-d97b809badec', 'name': 'network-vif-deleted', 'tag': '99cee46a-5a67-4591-9758-17595dab4c44'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:08:54.832575 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-80ca54ff-c848-4481-ba64-f7e0ab52c14c req-b0114345-d2c8-4d77-977c-f617b2622e77 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.70 "DELETE /v2.0/ports/99cee46a-5a67-4591-9758-17595dab4c44 HTTP/1.1" status: 204 len: 173 time: 2.0150762 Feb 17 18:08:54.848662 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Notify callbacks [] for port, precommit_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:54.866192 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Transition to ACTIVE for port object babc7f9f-a62e-4d31-9f66-a2e5ad339378 will not be triggered until provisioned by entity L2. {{(pid=84113) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:08:54.894036 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:54.924686 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:55.007362 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1723bd57-1ccb-4931-8a29-3f787d241083 req-b859ba8a-35e7-42b5-aed1-d97adcc19857 service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.6822026 Feb 17 18:08:55.045764 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6149e506-e5a3-4db4-8c81-76bf4ac36027 req-041a1995-b1c1-4e01-900f-f9ef5f3050d7 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:55.053557 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6149e506-e5a3-4db4-8c81-76bf4ac36027 req-041a1995-b1c1-4e01-900f-f9ef5f3050d7 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 943 time: 0.5490685 Feb 17 18:08:55.188236 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6149e506-e5a3-4db4-8c81-76bf4ac36027 req-a0697290-486f-443a-8da0-0cf16d976782 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1334305 Feb 17 18:08:55.237521 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a85c2308-1879-4314-8871-f992029f6a22 None None] Pushing event updated for resources: {'Port': ['ID=babc7f9f-a62e-4d31-9f66-a2e5ad339378,revision_number=3']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:55.240793 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a85c2308-1879-4314-8871-f992029f6a22 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.316s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:55.314823 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7004086-19e0-45b7-aeae-afc181c18594 req-fc2a1194-1ca1-4917-ad82-37ddbb7e84f2 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:55.321034 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a7004086-19e0-45b7-aeae-afc181c18594 req-fc2a1194-1ca1-4917-ad82-37ddbb7e84f2 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.4059300 Feb 17 18:08:55.331069 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'da2d8b28-dcf2-4089-aaa7-d97b809badec', 'name': 'network-vif-deleted', 'tag': '99cee46a-5a67-4591-9758-17595dab4c44', 'status': 'completed', 'code': 200} Feb 17 18:08:55.386916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74a9ebcd-ff14-44c6-b7d6-6634c4b23e07 req-a1313a74-1a64-4362-a288-06258a647172 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:55.392821 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-74a9ebcd-ff14-44c6-b7d6-6634c4b23e07 req-a1313a74-1a64-4362-a288-06258a647172 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c2e8792284c348238cf9afdcae0c221e&device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 1160 time: 0.2839212 Feb 17 18:08:55.404803 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a7004086-19e0-45b7-aeae-afc181c18594 req-9d15d176-02ee-46e6-9776-810492a5727a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0772650 Feb 17 18:08:55.645273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Attempting to bind port babc7f9f-a62e-4d31-9f66-a2e5ad339378 on host dv-cinder-760194-3-iscsi for vnic_type normal with profile {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:08:55.646690 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Attempting to bind port babc7f9f-a62e-4d31-9f66-a2e5ad339378 by drivers openvswitch on host dv-cinder-760194-3-iscsi at level 0 using segments [{'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:08:55.647443 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Attempting to bind port babc7f9f-a62e-4d31-9f66-a2e5ad339378 on network 6755b14b-f6f6-43aa-a697-3921175c5230 {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:08:55.656541 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Checking agent: {'id': '3fdd9543-fb8c-4d73-992e-15dd132fbdf2', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760194-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 17, 57, 42), 'started_at': datetime.datetime(2021, 2, 17, 17, 58, 12), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 8, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760194-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.58', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:08:55.657296 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Checking segment: {'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'} for mappings: {'physnet1': 'br-data'} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84113) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:08:55.658579 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:55.659708 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Bound using segment: {'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'} {{(pid=84113) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:08:55.660457 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Bound port: babc7f9f-a62e-4d31-9f66-a2e5ad339378, host: dv-cinder-760194-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'}}] {{(pid=84113) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:08:55.661069 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:55.682381 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74a9ebcd-ff14-44c6-b7d6-6634c4b23e07 req-da309bd9-7b70-4f1c-961e-c3ef3b2e4f17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:55.707912 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-74a9ebcd-ff14-44c6-b7d6-6634c4b23e07 req-da309bd9-7b70-4f1c-961e-c3ef3b2e4f17 service neutron] 10.222.0.70 "GET /v2.0/networks?id=ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 200 len: 909 time: 0.3019869 Feb 17 18:08:55.793672 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] For port babc7f9f-a62e-4d31-9f66-a2e5ad339378, host dv-cinder-760194-3-iscsi, cleared binding levels {{(pid=84113) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:08:55.800527 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] For port babc7f9f-a62e-4d31-9f66-a2e5ad339378, host dv-cinder-760194-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=babc7f9f-a62e-4d31-9f66-a2e5ad339378,segment=NetworkSegment(26bc7590-668d-4f62-883e-3f8e0fb997b0),segment_id=26bc7590-668d-4f62-883e-3f8e0fb997b0)] {{(pid=84113) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:08:55.808435 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-74a9ebcd-ff14-44c6-b7d6-6634c4b23e07 req-06fff741-80fd-49a3-9c58-e38ae7cca5d8 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=75d0676f-fef4-4868-aa7b-f5dda8df8073 HTTP/1.1" status: 200 len: 217 time: 0.0873983 Feb 17 18:08:55.841063 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:55.892003 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74a9ebcd-ff14-44c6-b7d6-6634c4b23e07 req-e1cfac03-35fb-46d5-b01c-37570f45fbe0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:55.894042 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-74a9ebcd-ff14-44c6-b7d6-6634c4b23e07 req-e1cfac03-35fb-46d5-b01c-37570f45fbe0 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=e1b65f5a-677d-4368-874f-50623d3454b9 HTTP/1.1" status: 200 len: 855 time: 0.0737867 Feb 17 18:08:55.943407 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c7ac0713-f637-4b05-a311-3d455289e99d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:55.982010 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d526cfc3-eb99-41ee-844f-5136e5f691de req-67049245-389d-4569-b6dd-c77af7e0d9c2 tempest-VolumesActionsTest-1456757085 tempest-VolumesActionsTest-1456757085-project] 10.222.0.13 "GET /v2.0/ports?device_id=da2d8b28-dcf2-4089-aaa7-d97b809badec HTTP/1.1" status: 200 len: 210 time: 0.0873549 Feb 17 18:08:55.989100 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-74a9ebcd-ff14-44c6-b7d6-6634c4b23e07 req-500ff7b9-ebb9-4ce1-b8fb-603f9af9a216 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=ee1c48e9-8681-4765-bc5b-bc0215d911a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0530491 Feb 17 18:08:56.150031 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-74a9ebcd-ff14-44c6-b7d6-6634c4b23e07 req-28deaeff-3973-49fe-b2f3-fc840d92c30e service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1522260 Feb 17 18:08:56.297948 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a85c2308-1879-4314-8871-f992029f6a22 None None] Pushing event updated for resources: {'Port': ['ID=babc7f9f-a62e-4d31-9f66-a2e5ad339378,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:56.304534 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a85c2308-1879-4314-8871-f992029f6a22 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.361s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:56.360917 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Routers {'742dfc39-339a-428f-8a3f-88d236afaaf4'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:08:56.377769 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:08:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['742dfc39-339a-428f-8a3f-88d236afaaf4'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:56.455634 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-74a9ebcd-ff14-44c6-b7d6-6634c4b23e07 req-8ce16b45-bcf6-4527-9842-a8780c763c62 service neutron] 10.222.0.70 "GET /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2963407 Feb 17 18:08:56.752709 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992898bf-b28c-422c-9a53-babf6079cfac req-d0efe570-af25-4962-9133-d44b8459f40e tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:56.752925 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] Set router 742dfc39-339a-428f-8a3f-88d236afaaf4 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:08:56.754359 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-992898bf-b28c-422c-9a53-babf6079cfac req-d0efe570-af25-4962-9133-d44b8459f40e tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 943 time: 0.2929370 Feb 17 18:08:56.795422 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b1d63d7-616d-4f50-8f86-d9a4c5ade1cf req-dc56564c-5ce8-4f40-bbc4-3ebe7c986575 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:56.797264 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0b1d63d7-616d-4f50-8f86-d9a4c5ade1cf req-dc56564c-5ce8-4f40-bbc4-3ebe7c986575 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1683426 Feb 17 18:08:56.874353 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-992898bf-b28c-422c-9a53-babf6079cfac req-6307ad11-9394-4c60-9cce-f41e774dff53 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1121435 Feb 17 18:08:56.897339 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0b1d63d7-616d-4f50-8f86-d9a4c5ade1cf req-652d3568-a563-41ab-ad30-f7c3fac0edee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0901773 Feb 17 18:08:57.157526 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82cfdfb4-e2c0-44d8-a1bc-cfb9fb290b84 req-f01cbada-bc7e-4cd4-a3f2-111c93bdbc70 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:57.159700 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-82cfdfb4-e2c0-44d8-a1bc-cfb9fb290b84 req-f01cbada-bc7e-4cd4-a3f2-111c93bdbc70 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1424162 Feb 17 18:08:57.189324 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:08:48Z', 'revision_number': 4, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': 'babc7f9f-a62e-4d31-9f66-a2e5ad339378', 'name': '', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'mac_address': 'fa:16:3e:6a:c4:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:47Z', 'updated_at': '2021-02-17T18:08:55Z', 'revision_number': 4, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'subnets': [{'id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:08:57.198221 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7eb9451c-dcef-476c-a59e-9f0986e803a4 None None] The sync data for ids ['742dfc39-339a-428f-8a3f-88d236afaaf4'] in dv-cinder-760194-3-iscsi is: [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:08:48Z', 'revision_number': 4, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': 'babc7f9f-a62e-4d31-9f66-a2e5ad339378', 'name': '', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'mac_address': 'fa:16:3e:6a:c4:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:47Z', 'updated_at': '2021-02-17T18:08:55Z', 'revision_number': 4, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'subnets': [{'id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}] {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:08:57.233874 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-82cfdfb4-e2c0-44d8-a1bc-cfb9fb290b84 req-60d78fa0-933d-4782-9f34-57e86d5a2b50 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662889 Feb 17 18:08:58.117226 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab501eb9-a959-4094-bb7f-0d2c4854eee8 req-b274680a-9123-4482-9a04-a53b52bc62cf tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:58.118904 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ab501eb9-a959-4094-bb7f-0d2c4854eee8 req-b274680a-9123-4482-9a04-a53b52bc62cf tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 943 time: 0.1027920 Feb 17 18:08:58.169035 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ab501eb9-a959-4094-bb7f-0d2c4854eee8 req-93d22591-df55-4808-ab85-a74f7ae87eaa tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438254 Feb 17 18:08:58.400632 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e04f8bd1-c57d-45e3-9fcb-b7b50d66ff16 req-ad96a8d9-803e-404a-85a8-7f1b9bb7da0d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:58.402244 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e04f8bd1-c57d-45e3-9fcb-b7b50d66ff16 req-ad96a8d9-803e-404a-85a8-7f1b9bb7da0d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1263313 Feb 17 18:08:58.450536 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e04f8bd1-c57d-45e3-9fcb-b7b50d66ff16 req-906f733e-8da7-4e33-ae63-40a30e998337 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414767 Feb 17 18:08:58.768970 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device babc7f9f-a62e-4d31-9f66-a2e5ad339378 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:58.963442 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning for port babc7f9f-a62e-4d31-9f66-a2e5ad339378 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:08:58.972979 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port babc7f9f-a62e-4d31-9f66-a2e5ad339378 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:58.973404 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:59.165671 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:59.178231 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 75d0676f-fef4-4868-aa7b-f5dda8df8073 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:08:59.281042 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] For port babc7f9f-a62e-4d31-9f66-a2e5ad339378, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=babc7f9f-a62e-4d31-9f66-a2e5ad339378,segment=NetworkSegment(26bc7590-668d-4f62-883e-3f8e0fb997b0),segment_id=26bc7590-668d-4f62-883e-3f8e0fb997b0)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:08:59.322719 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:59.328651 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:59.377574 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning for port 75d0676f-fef4-4868-aa7b-f5dda8df8073 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:08:59.398027 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 75d0676f-fef4-4868-aa7b-f5dda8df8073 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:08:59.398738 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:59.472944 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6309b9f-3b44-4bf6-8943-5837c93ed9f6 req-4febe128-cb13-4a9a-9383-164c2861f5a8 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:59.475190 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d6309b9f-3b44-4bf6-8943-5837c93ed9f6 req-4febe128-cb13-4a9a-9383-164c2861f5a8 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 943 time: 0.1295047 Feb 17 18:08:59.519858 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Pushing event updated for resources: {'Port': ['ID=babc7f9f-a62e-4d31-9f66-a2e5ad339378,revision_number=5']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:59.560497 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.560824 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.561209 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.561720 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.562113 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.562486 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.562858 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.563383 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.563745 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.564142 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.564514 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.564706 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d6309b9f-3b44-4bf6-8943-5837c93ed9f6 req-381f7f93-b6c3-41d5-8d59-822afab9df10 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0805569 Feb 17 18:08:59.564881 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.565271 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.565642 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.566013 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.578185 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.578657 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.579049 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.579432 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.579814 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.582144 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.582533 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.582913 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.583263 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:08:59.606774 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:59.653084 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:59.685245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ce54bae9-f6d3-439f-b544-92e481dfd9dc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75d0676f-fef4-4868-aa7b-f5dda8df8073'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:08:59.709413 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port 75d0676f-fef4-4868-aa7b-f5dda8df8073, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=75d0676f-fef4-4868-aa7b-f5dda8df8073,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:08:59.762846 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:08:59.765160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:08:59.824613 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ce54bae9-f6d3-439f-b544-92e481dfd9dc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75d0676f-fef4-4868-aa7b-f5dda8df8073', 'code': 200} Feb 17 18:08:59.841021 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37bad7ef-f784-49be-b241-470e7084bf49 req-4786eb52-efbf-42a5-8732-2650c96c886d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:08:59.842890 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-37bad7ef-f784-49be-b241-470e7084bf49 req-4786eb52-efbf-42a5-8732-2650c96c886d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1751852 Feb 17 18:08:59.906651 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=75d0676f-fef4-4868-aa7b-f5dda8df8073,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:08:59.910673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:08:59.960034 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-37bad7ef-f784-49be-b241-470e7084bf49 req-972f674c-0f89-4ce0-9c5f-9a9679f4cfc8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1039166 Feb 17 18:09:00.210612 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f0a0b8-910b-4f05-8bb1-2cddbb51bb9d req-91d19877-130d-4e67-aaa5-33bfe1cdf0cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:00.213002 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f0f0a0b8-910b-4f05-8bb1-2cddbb51bb9d req-91d19877-130d-4e67-aaa5-33bfe1cdf0cc service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 1162 time: 0.1079326 Feb 17 18:09:00.310694 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f0f0a0b8-910b-4f05-8bb1-2cddbb51bb9d req-e6f1d3f6-7cf8-4fe4-9a1e-aa8e04eaf287 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0865998 Feb 17 18:09:00.340361 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 75d0676f-fef4-4868-aa7b-f5dda8df8073 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:09:00.385933 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 57278) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:09:00.427739 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port 75d0676f-fef4-4868-aa7b-f5dda8df8073 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:09:00.428464 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:00.547808 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e077dfbf-c3a6-43d7-b554-8069b07cbac9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:00.565665 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e077dfbf-c3a6-43d7-b554-8069b07cbac9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:09:00.570411 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e077dfbf-c3a6-43d7-b554-8069b07cbac9 admin admin] Usage tracker for resource:security_group_rule and tenant:56b0600118954c8cb305b6f08a099f53 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:09:00.574011 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e077dfbf-c3a6-43d7-b554-8069b07cbac9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:09:00.580000 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e077dfbf-c3a6-43d7-b554-8069b07cbac9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:09:00.672867 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e077dfbf-c3a6-43d7-b554-8069b07cbac9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:00.714561 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e077dfbf-c3a6-43d7-b554-8069b07cbac9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:00.726800 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device babc7f9f-a62e-4d31-9f66-a2e5ad339378 up at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:09:00.734857 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e969b262-272d-45bb-9819-87508c48e8e3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:00.805269 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e077dfbf-c3a6-43d7-b554-8069b07cbac9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f292acb9-cf56-46bd-a663-e13142b05ca8,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:00.812427 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e077dfbf-c3a6-43d7-b554-8069b07cbac9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:00.824676 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e077dfbf-c3a6-43d7-b554-8069b07cbac9 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=56b0600118954c8cb305b6f08a099f53&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4352336 Feb 17 18:09:00.825493 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 57286) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:09:00.862254 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Provisioning complete for port babc7f9f-a62e-4d31-9f66-a2e5ad339378 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:09:00.862693 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:00.898013 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3659a13-706d-4047-b203-f63a78198fd4 req-443dcc34-b427-41c6-9ddd-edc022055d3b tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:00.900150 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a3659a13-706d-4047-b203-f63a78198fd4 req-443dcc34-b427-41c6-9ddd-edc022055d3b tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 945 time: 0.1462135 Feb 17 18:09:00.911334 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b620f193-f43a-4464-bd06-cf4f78e03c5d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:00.954643 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b620f193-f43a-4464-bd06-cf4f78e03c5d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:00.962553 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a3659a13-706d-4047-b203-f63a78198fd4 req-fad7c5a5-0e75-4282-9534-0f23b9c1ffbf tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529344 Feb 17 18:09:01.065431 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b620f193-f43a-4464-bd06-cf4f78e03c5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:01.071622 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-74ebc7cc-dddf-47bd-94e4-68dd23e512c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:01.083976 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b620f193-f43a-4464-bd06-cf4f78e03c5d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f292acb9-cf56-46bd-a663-e13142b05ca8,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:01.088645 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b620f193-f43a-4464-bd06-cf4f78e03c5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:01.092667 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b620f193-f43a-4464-bd06-cf4f78e03c5d admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:01.094019 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-b620f193-f43a-4464-bd06-cf4f78e03c5d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f292acb9-cf56-46bd-a663-e13142b05ca8 HTTP/1.1" status: 204 len: 168 time: 0.2652245 Feb 17 18:09:01.233145 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6179bd2-865d-49c1-b5b9-671b0a0da8f5 req-6b1bd811-c86f-4126-a432-8e627c8e8590 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:01.235058 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c6179bd2-865d-49c1-b5b9-671b0a0da8f5 req-6b1bd811-c86f-4126-a432-8e627c8e8590 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1038647 Feb 17 18:09:01.293430 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c6179bd2-865d-49c1-b5b9-671b0a0da8f5 req-324a504f-0820-4d3f-be45-9c635001c5a5 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500686 Feb 17 18:09:01.676097 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 57302) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:09:01.698482 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9099637e-8504-41cf-b445-048839d87dc2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:01.715351 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-9099637e-8504-41cf-b445-048839d87dc2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:09:01.720621 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-9099637e-8504-41cf-b445-048839d87dc2 admin admin] Usage tracker for resource:security_group_rule and tenant:900ddb3ec0994c428b92f676bd76140b is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:09:01.724042 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-9099637e-8504-41cf-b445-048839d87dc2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:09:01.730934 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-9099637e-8504-41cf-b445-048839d87dc2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:09:01.830276 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9099637e-8504-41cf-b445-048839d87dc2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:01.865436 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9099637e-8504-41cf-b445-048839d87dc2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:01.887411 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-eec37605-0f51-464b-b301-2369cec8f789 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:01.922482 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-9099637e-8504-41cf-b445-048839d87dc2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=900ddb3ec0994c428b92f676bd76140b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2449987 Feb 17 18:09:01.923485 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9099637e-8504-41cf-b445-048839d87dc2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=291ff909-58ca-47f6-9345-0f154d68becb,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:01.925399 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 57306) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:09:01.942182 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9099637e-8504-41cf-b445-048839d87dc2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:01.998223 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3d6fee79-4213-4258-abbf-6b5a9db3183f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:02.029524 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3d6fee79-4213-4258-abbf-6b5a9db3183f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:02.132906 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3d6fee79-4213-4258-abbf-6b5a9db3183f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:02.142911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f68a03a6-0e64-4fc6-8560-455a39649706 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:02.157784 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d6fee79-4213-4258-abbf-6b5a9db3183f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=291ff909-58ca-47f6-9345-0f154d68becb,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:02.165721 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3d6fee79-4213-4258-abbf-6b5a9db3183f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:02.177375 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3d6fee79-4213-4258-abbf-6b5a9db3183f admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:02.179089 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3d6fee79-4213-4258-abbf-6b5a9db3183f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/291ff909-58ca-47f6-9345-0f154d68becb HTTP/1.1" status: 204 len: 168 time: 0.2524078 Feb 17 18:09:02.206615 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a9eebd-041e-41d5-b76d-7bd87a11f8e3 req-e94bef5b-ff6a-40e2-aa70-4068c5c9a676 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:02.212357 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-47a9eebd-041e-41d5-b76d-7bd87a11f8e3 req-e94bef5b-ff6a-40e2-aa70-4068c5c9a676 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 945 time: 0.1212029 Feb 17 18:09:02.260864 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-47a9eebd-041e-41d5-b76d-7bd87a11f8e3 req-628a5ad2-9492-408e-8a86-ef84c58a11b8 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457518 Feb 17 18:09:02.523003 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce1bff81-ae91-47f2-8634-d369b9e0fd30 req-1e3667f6-10fe-45b0-bdf8-4e1ad22c9234 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:02.524757 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ce1bff81-ae91-47f2-8634-d369b9e0fd30 req-1e3667f6-10fe-45b0-bdf8-4e1ad22c9234 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1004910 Feb 17 18:09:02.575607 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ce1bff81-ae91-47f2-8634-d369b9e0fd30 req-c3de5dca-6670-46b0-912d-0c6d74e3f755 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446074 Feb 17 18:09:03.495950 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-327daee8-c3fd-4275-9c3c-21adaabab326 req-e149d3a4-3e11-4933-a701-be36e2b9acdb tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:03.503655 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-327daee8-c3fd-4275-9c3c-21adaabab326 req-e149d3a4-3e11-4933-a701-be36e2b9acdb tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 945 time: 0.1079352 Feb 17 18:09:03.563794 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-327daee8-c3fd-4275-9c3c-21adaabab326 req-16f8be87-be88-4c9c-8305-6ce7258a8d7e tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0591533 Feb 17 18:09:03.866998 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5954525b-b0e8-4f23-a988-6c8ea725da80 req-f8de9e6e-d65a-4750-8f15-4601cc225646 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:03.878471 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5954525b-b0e8-4f23-a988-6c8ea725da80 req-f8de9e6e-d65a-4750-8f15-4601cc225646 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1619165 Feb 17 18:09:03.936126 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5954525b-b0e8-4f23-a988-6c8ea725da80 req-189a7153-610d-4c68-b8c3-7176f6aabeea tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0566170 Feb 17 18:09:04.839715 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-903d5668-0327-4945-8b05-531bbfda8e80 req-089fe320-8a63-48da-b59f-7c36ddda6de4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:04.848545 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-903d5668-0327-4945-8b05-531bbfda8e80 req-089fe320-8a63-48da-b59f-7c36ddda6de4 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 945 time: 0.1047471 Feb 17 18:09:04.906555 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-903d5668-0327-4945-8b05-531bbfda8e80 req-3aa009e2-f938-4e76-92be-f4be3f4c9ac7 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560892 Feb 17 18:09:05.189516 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03cc7177-c18b-4d2c-ac2d-179f9f0fb3fb req-a53a3110-8368-4598-bba6-e164856a8962 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:05.191131 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-03cc7177-c18b-4d2c-ac2d-179f9f0fb3fb req-a53a3110-8368-4598-bba6-e164856a8962 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0970547 Feb 17 18:09:05.247259 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-03cc7177-c18b-4d2c-ac2d-179f9f0fb3fb req-26b578d3-698f-42f9-8ab8-1e79b6c748aa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462933 Feb 17 18:09:06.148124 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14d24622-921c-4860-8aa6-99cb1d48fa91 req-abff8128-1ba3-4a97-986e-01728d686c7f tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:06.149729 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-14d24622-921c-4860-8aa6-99cb1d48fa91 req-abff8128-1ba3-4a97-986e-01728d686c7f tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 945 time: 0.1145349 Feb 17 18:09:06.215092 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-14d24622-921c-4860-8aa6-99cb1d48fa91 req-7194c9e5-7a9f-4049-8823-481673229b67 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590620 Feb 17 18:09:06.492656 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaaa622f-8d52-40d2-997b-04c2bf6f74af req-efcd0217-852b-4f17-96d0-01a4832b3cdf tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:06.494467 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-aaaa622f-8d52-40d2-997b-04c2bf6f74af req-efcd0217-852b-4f17-96d0-01a4832b3cdf tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1141794 Feb 17 18:09:06.546841 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-aaaa622f-8d52-40d2-997b-04c2bf6f74af req-8e57542b-3374-48fe-85cc-cdace997d736 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457880 Feb 17 18:09:07.682383 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c2a46b2a-928f-4323-a1cb-38b4c5478f26 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:07.776061 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31f45dc6-ed73-4cab-9f2e-4a158729e398 req-805332bb-e8c2-435a-b95d-5b7f9c4230e8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:07.778077 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-31f45dc6-ed73-4cab-9f2e-4a158729e398 req-805332bb-e8c2-435a-b95d-5b7f9c4230e8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0998001 Feb 17 18:09:07.830331 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-31f45dc6-ed73-4cab-9f2e-4a158729e398 req-aecadb5f-a46b-4ec6-a9d9-7a96729bb429 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451422 Feb 17 18:09:07.986977 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14b205e2-68be-4c6e-99a3-f569a87172da req-7bad5f4a-e8d1-4ec7-a087-6a1f90c421f3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:07.988621 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-14b205e2-68be-4c6e-99a3-f569a87172da req-7bad5f4a-e8d1-4ec7-a087-6a1f90c421f3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0856311 Feb 17 18:09:08.237722 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-14b205e2-68be-4c6e-99a3-f569a87172da req-e1d40acc-47a6-4c12-a3e0-81cdb9ac2595 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2427256 Feb 17 18:09:08.597430 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-c8eb6b6d-d63d-4c9a-b84a-dba38ce2c29e tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:08.599543 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-c8eb6b6d-d63d-4c9a-b84a-dba38ce2c29e tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/networks?id=6755b14b-f6f6-43aa-a697-3921175c5230 HTTP/1.1" status: 200 len: 815 time: 0.1551683 Feb 17 18:09:08.616146 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0af69724-e231-4afe-9794-9bfb18f9df09 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/quotas/5729c656e2c64606a663d6434a5c3973 HTTP/1.1" status: 200 len: 375 time: 0.0104356 Feb 17 18:09:08.703254 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-8da194e3-dd07-41fc-bd23-5b047d4e0997 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=5729c656e2c64606a663d6434a5c3973&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0811994 Feb 17 18:09:08.850439 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-671d237c-4550-4490-bfcd-05987e48071b service neutron] 10.222.0.13 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1348188 Feb 17 18:09:09.057495 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-532102cb-ec47-4f7e-8996-a3a63360f62e service neutron] 10.222.0.13 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2006338 Feb 17 18:09:09.075533 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74e0632c-383f-4f57-a2c6-6ba84064d71d req-143ba72e-230c-481b-9fa8-5db5ddb032a0 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:09.077095 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-74e0632c-383f-4f57-a2c6-6ba84064d71d req-143ba72e-230c-481b-9fa8-5db5ddb032a0 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1245058 Feb 17 18:09:09.135074 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-74e0632c-383f-4f57-a2c6-6ba84064d71d req-8589175d-c6ae-4ec9-a5e3-d7a03c38c886 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422525 Feb 17 18:09:09.340367 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ada7b047-7c80-40c3-9ac0-a5bfee2dad22 req-13e521c3-4304-4c2f-8245-ceeb7c3fbc47 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 210 time: 0.0488067 Feb 17 18:09:09.451665 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f578e06-8bb6-4a33-9de4-4e4b36edb762 req-1310a7a2-4334-4e38-ac9c-21cf4b42ea35 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:09.453327 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6f578e06-8bb6-4a33-9de4-4e4b36edb762 req-1310a7a2-4334-4e38-ac9c-21cf4b42ea35 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0904830 Feb 17 18:09:09.502372 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6f578e06-8bb6-4a33-9de4-4e4b36edb762 req-bc77a97f-e3a0-4b8a-87c2-bc72042dfc14 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416467 Feb 17 18:09:09.830368 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-6f3d4949-7d29-4382-b5ad-d832f04542c1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:10.391950 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5445b765-aae7-4158-b42a-9cdace8cc785 req-8643e0f7-9bbb-4c34-8933-7bcd0c436f65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:10.393630 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5445b765-aae7-4158-b42a-9cdace8cc785 req-8643e0f7-9bbb-4c34-8933-7bcd0c436f65 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 1162 time: 0.1095707 Feb 17 18:09:10.406061 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ad9b81-373d-4265-a747-bf23bbc102ac req-1f020158-db77-4667-bfdf-fb16b5048ab1 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:10.407636 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-67ad9b81-373d-4265-a747-bf23bbc102ac req-1f020158-db77-4667-bfdf-fb16b5048ab1 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1641901 Feb 17 18:09:10.621968 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ba56dda2-1b82-4c57-8dc7-67fb5c394c52 req-48b3fde8-35ab-4c20-b228-bd88ebb0150f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 210 time: 0.1051104 Feb 17 18:09:10.667340 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-67ad9b81-373d-4265-a747-bf23bbc102ac req-cb51bf71-de02-446d-8148-bdf7ca9bdcb8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2304075 Feb 17 18:09:10.736743 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5445b765-aae7-4158-b42a-9cdace8cc785 req-c030f9d4-00f1-433f-a6fd-8d772d802570 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:10.738424 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5445b765-aae7-4158-b42a-9cdace8cc785 req-c030f9d4-00f1-433f-a6fd-8d772d802570 service neutron] 10.222.0.70 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 913 time: 0.3278394 Feb 17 18:09:10.842614 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:10.889933 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5445b765-aae7-4158-b42a-9cdace8cc785 req-44c6c8e1-2f5a-478f-b7ba-c32bab7aa5f9 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c3de3799-da31-433f-9203-bfbce68f8d59 HTTP/1.1" status: 200 len: 217 time: 0.1436779 Feb 17 18:09:10.980657 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5445b765-aae7-4158-b42a-9cdace8cc785 req-c3c0dec0-7c42-4da8-be56-eb552cd857f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:10.984909 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5445b765-aae7-4158-b42a-9cdace8cc785 req-c3c0dec0-7c42-4da8-be56-eb552cd857f9 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=c04f01da-1295-4b8a-95ae-46589cb07040 HTTP/1.1" status: 200 len: 859 time: 0.0832973 Feb 17 18:09:10.996221 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca83d1e5-0481-4ece-b117-7a2b25f6890d req-e0b2b775-d02e-4c38-8763-0bc3d4a6e458 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:11.003949 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ca83d1e5-0481-4ece-b117-7a2b25f6890d req-e0b2b775-d02e-4c38-8763-0bc3d4a6e458 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1741083 Feb 17 18:09:11.080617 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5445b765-aae7-4158-b42a-9cdace8cc785 req-6cb5f483-5f18-4591-beb5-15f540144701 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4aaf4a03-4480-421f-bff4-f9814e969001&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0609796 Feb 17 18:09:11.185742 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ca83d1e5-0481-4ece-b117-7a2b25f6890d req-e979c17c-ea03-4646-82a1-ba5cd8b5de54 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1808484 Feb 17 18:09:11.257999 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5445b765-aae7-4158-b42a-9cdace8cc785 req-fb2997a2-a035-4385-999d-aece87ae0eac service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1678047 Feb 17 18:09:11.464606 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5445b765-aae7-4158-b42a-9cdace8cc785 req-dca93184-72f4-4524-ae6c-d48b94342f59 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1982269 Feb 17 18:09:11.747273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-fe85a78b-24e2-482c-a28b-d6e2ae20542a tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:11.749194 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-fe85a78b-24e2-482c-a28b-d6e2ae20542a tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.70 "GET /v2.0/networks?id=6755b14b-f6f6-43aa-a697-3921175c5230 HTTP/1.1" status: 200 len: 815 time: 0.2358780 Feb 17 18:09:11.770556 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Request body: {'port': {'device_id': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'admin_state_up': True, 'tenant_id': '5729c656e2c64606a663d6434a5c3973'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:09:11.993757 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8ea1e844-5eb8-489e-a647-776d4792a666 req-068525a8-490a-4d21-8c68-591d187ff296 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 210 time: 0.1037071 Feb 17 18:09:12.008725 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:12.089969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6290e94e-834a-4527-9817-bbb4369da9ed req-5e8bbe33-d16b-44c5-aa24-50674139acdb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:12.091504 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6290e94e-834a-4527-9817-bbb4369da9ed req-5e8bbe33-d16b-44c5-aa24-50674139acdb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.2019951 Feb 17 18:09:12.100563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:09:12.122122 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Usage tracker for resource:port and tenant:5729c656e2c64606a663d6434a5c3973 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:09:12.129929 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Quota usage for port was recalculated. Used quota:2. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:09:12.138700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:09:12.169936 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6290e94e-834a-4527-9817-bbb4369da9ed req-de52e0c2-92ba-454e-8b6b-d48dbf128a18 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0713384 Feb 17 18:09:12.211160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Made reservation on behalf of 5729c656e2c64606a663d6434a5c3973 for: {'port': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:09:12.217679 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:12.762873 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:12.878927 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-916a4318-9f4b-4bd9-89c0-b705df86d5fc req-244a0214-1a3b-48bc-9f62-f8b7dc1753ca tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:12.881004 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-916a4318-9f4b-4bd9-89c0-b705df86d5fc req-244a0214-1a3b-48bc-9f62-f8b7dc1753ca tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1942909 Feb 17 18:09:12.992182 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Allocated IP 172.20.0.7 (6755b14b-f6f6-43aa-a697-3921175c5230/8a96f440-286f-407f-9d7e-b3b2727a69a9/e5b8b8b3-6466-4164-8a2d-7627684ce9d0) {{(pid=84111) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:09:12.996789 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-916a4318-9f4b-4bd9-89c0-b705df86d5fc req-62e35614-ef63-4994-a546-0973b7f356df tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0784411 Feb 17 18:09:13.201010 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d3377c0d-27ca-4a2e-be57-cf8ffc8b2e67 req-d2fd3f07-5a45-4fe1-b4d9-1bbacc2e0dc1 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 210 time: 0.0574827 Feb 17 18:09:13.289352 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for port, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:13.306904 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Transition to ACTIVE for port object e5b8b8b3-6466-4164-8a2d-7627684ce9d0 will not be triggered until provisioned by entity DHCP. {{(pid=84111) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:09:13.408533 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:13.438014 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c8cb8a8c-d21c-4630-a32c-42d695d4552c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:13.589174 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Pushing event updated for resources: {'Port': ['ID=e5b8b8b3-6466-4164-8a2d-7627684ce9d0,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:13.593029 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:13.644933 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb43dbe6-b647-4115-8ab9-5ba4e20d889a req-8b1f67f9-456d-41e7-b54d-d78e44a74f14 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:13.647120 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fb43dbe6-b647-4115-8ab9-5ba4e20d889a req-8b1f67f9-456d-41e7-b54d-d78e44a74f14 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.2864358 Feb 17 18:09:13.699963 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Network 6755b14b-f6f6-43aa-a697-3921175c5230 is already hosted by enough agents. {{(pid=84111) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:09:13.703639 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Resources bound (agent type, host, resource id): {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:09:13.706229 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Received port after_create {{(pid=84111) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:09:13.751547 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fb43dbe6-b647-4115-8ab9-5ba4e20d889a req-50bbb277-94f8-4333-99e2-0a8a25d4663e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0975869 Feb 17 18:09:13.804463 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:13.805243 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:13.883551 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-0dc02bc2-2b2a-449e-b7a4-18ea739f51fd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1174743 Feb 17 18:09:14.031341 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-c2bb4cf7-db26-4624-b095-f4bf97c9eb0b None None] Provisioning for port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 completed by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:09:14.037564 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-c2bb4cf7-db26-4624-b095-f4bf97c9eb0b None None] Provisioning complete for port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:09:14.037993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c2bb4cf7-db26-4624-b095-f4bf97c9eb0b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:14.108049 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-c2bb4cf7-db26-4624-b095-f4bf97c9eb0b None None] Port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 cannot update to ACTIVE because it is not bound. {{(pid=84113) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:332}} Feb 17 18:09:14.228903 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a71650b-15ac-4a52-b462-99ef365bab19 req-d066f09c-6a18-4a2c-8fe2-93809c6bda59 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:14.230444 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5a71650b-15ac-4a52-b462-99ef365bab19 req-d066f09c-6a18-4a2c-8fe2-93809c6bda59 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1018307 Feb 17 18:09:14.288566 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5a71650b-15ac-4a52-b462-99ef365bab19 req-e0b199b7-1617-4e64-800c-91faa3762acc tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488105 Feb 17 18:09:14.492876 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a850044f-a351-469d-bfd2-56892b0800ad req-339684c5-e63f-4fd1-ad6b-09ad8c43763b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:14.493649 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-a850044f-a351-469d-bfd2-56892b0800ad req-339684c5-e63f-4fd1-ad6b-09ad8c43763b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Synchronizing usage tracker for tenant:5729c656e2c64606a663d6434a5c3973 on resource:port {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:09:14.631421 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-a850044f-a351-469d-bfd2-56892b0800ad req-339684c5-e63f-4fd1-ad6b-09ad8c43763b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Unset dirty status for tenant:5729c656e2c64606a663d6434a5c3973 on resource:port {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:09:14.632812 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a850044f-a351-469d-bfd2-56892b0800ad req-339684c5-e63f-4fd1-ad6b-09ad8c43763b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 931 time: 0.2352827 Feb 17 18:09:14.694871 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a850044f-a351-469d-bfd2-56892b0800ad req-4a7414d4-6a40-41f0-9187-5afb1e87a7ff tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557084 Feb 17 18:09:14.993797 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65f0ae93-be16-490a-8fe0-9797783ce2b2 req-22c54993-c23b-4265-97e2-0bb453f96838 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:14.995653 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-65f0ae93-be16-490a-8fe0-9797783ce2b2 req-22c54993-c23b-4265-97e2-0bb453f96838 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0884550 Feb 17 18:09:15.048365 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-65f0ae93-be16-490a-8fe0-9797783ce2b2 req-28f01374-0a6b-4628-b9d9-7e3ede2f8086 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460103 Feb 17 18:09:15.154781 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Request body: {'port': {'device_id': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:09:15.300399 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:15.303121 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:09:15.396591 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:09:15.397211 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:15.665618 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16dc94d9-2991-4ece-81ed-f61b6df6bed7 req-991825ab-6ee4-434e-986e-c4274e9db97d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:15.667537 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-16dc94d9-2991-4ece-81ed-f61b6df6bed7 req-991825ab-6ee4-434e-986e-c4274e9db97d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.2437420 Feb 17 18:09:16.076482 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-16dc94d9-2991-4ece-81ed-f61b6df6bed7 req-4e5b455f-485e-43d7-a0a4-a6c00d7a8132 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3875244 Feb 17 18:09:16.100881 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e5b8b8b3-6466-4164-8a2d-7627684ce9d0 {{(pid=84111) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:229}} Feb 17 18:09:16.118996 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:09:16.129424 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Notify callbacks [] for port, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:16.157835 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80277423-e634-49e8-9f4c-31f8fadd2d86 req-c02c092d-108a-46f0-9afb-eec9b794aac0 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:16.159457 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-80277423-e634-49e8-9f4c-31f8fadd2d86 req-c02c092d-108a-46f0-9afb-eec9b794aac0 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 931 time: 0.1656153 Feb 17 18:09:16.202943 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Transition to ACTIVE for port object e5b8b8b3-6466-4164-8a2d-7627684ce9d0 will not be triggered until provisioned by entity L2. {{(pid=84111) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:09:16.248435 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-80277423-e634-49e8-9f4c-31f8fadd2d86 req-5985aed4-4a53-4975-b280-0a558a52de3f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0815098 Feb 17 18:09:16.249525 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4125045'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:16.360440 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1a83800c-7a14-41e1-a222-708f7744d43e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:16.535431 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Pushing event updated for resources: {'Port': ['ID=e5b8b8b3-6466-4164-8a2d-7627684ce9d0,revision_number=2']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:16.539496 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:16.597947 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f066bd2-cd03-4f7d-8428-823522c1bed9 req-0e4f4f9b-5a5b-4ffa-9061-a90d654773ea tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:16.600438 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5f066bd2-cd03-4f7d-8428-823522c1bed9 req-0e4f4f9b-5a5b-4ffa-9061-a90d654773ea tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.2411990 Feb 17 18:09:16.885135 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5f066bd2-cd03-4f7d-8428-823522c1bed9 req-4719f3b2-c942-4fe7-9914-fdb497d4c0a4 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1795194 Feb 17 18:09:16.920946 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Attempting to bind port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:09:16.921652 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Attempting to bind port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 by drivers openvswitch on host hv-cinder-76019 at level 0 using segments [{'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'}] {{(pid=84111) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:09:16.922233 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Attempting to bind port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 on network 6755b14b-f6f6-43aa-a697-3921175c5230 {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:09:16.931335 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Checking agent: {'id': '35b9bf9c-0314-48b9-bb29-ba3a04c8b13c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 18, 4, 47), 'started_at': datetime.datetime(2021, 2, 17, 18, 5, 17), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 8, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.34', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:09:16.935849 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Checking segment: {'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'} for mappings: {} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84111) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:09:16.935849 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:16.935849 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Bound using segment: {'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'} {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:09:16.935849 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Bound port: e5b8b8b3-6466-4164-8a2d-7627684ce9d0, host: hv-cinder-76019, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '26bc7590-668d-4f62-883e-3f8e0fb997b0', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 6, 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230'}}] {{(pid=84111) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:09:16.935849 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:17.062311 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] For port e5b8b8b3-6466-4164-8a2d-7627684ce9d0, host hv-cinder-76019, cleared binding levels {{(pid=84111) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:09:17.066863 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] For port e5b8b8b3-6466-4164-8a2d-7627684ce9d0, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0,segment=NetworkSegment(26bc7590-668d-4f62-883e-3f8e0fb997b0),segment_id=26bc7590-668d-4f62-883e-3f8e0fb997b0)] {{(pid=84111) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:09:17.101040 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4125045'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:17.138742 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:17.688452 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:17.736502 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Pushing event updated for resources: {'Port': ['ID=e5b8b8b3-6466-4164-8a2d-7627684ce9d0,revision_number=3']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:17.758875 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.620s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:17.777760 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ce41fd-4c1a-4c87-9949-d90016080901 req-9218cf4a-0933-4f5f-b324-e8d571f85505 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:17.779689 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-89ce41fd-4c1a-4c87-9949-d90016080901 req-9218cf4a-0933-4f5f-b324-e8d571f85505 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.3915074 Feb 17 18:09:17.821502 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35d9ab4e-f285-47af-920b-1e063903800c req-e30f9a3d-f6af-4653-8aec-dbb709bcb9c1 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:17.823942 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-35d9ab4e-f285-47af-920b-1e063903800c req-e30f9a3d-f6af-4653-8aec-dbb709bcb9c1 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.3398089 Feb 17 18:09:17.869446 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:17.870140 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:17.871633 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] 10.222.0.70 "PUT /v2.0/ports/e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 1157 time: 2.7223527 Feb 17 18:09:17.877835 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:09:17.924822 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-89ce41fd-4c1a-4c87-9949-d90016080901 req-86d4d3ec-4fb2-4de2-a9b6-0e0b292eb817 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1342711 Feb 17 18:09:17.941760 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-35d9ab4e-f285-47af-920b-1e063903800c req-b5f8135d-3ab1-464d-8df7-bd815d636ddf tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1095142 Feb 17 18:09:18.003955 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0', 'status': 'completed', 'code': 200} Feb 17 18:09:18.513183 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7172c79-41b6-4ff7-a0f0-87b3b3fa2ff5 req-7150416b-529b-474d-a08d-4f0400650fcf tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:18.521356 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e7172c79-41b6-4ff7-a0f0-87b3b3fa2ff5 req-7150416b-529b-474d-a08d-4f0400650fcf tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.3971589 Feb 17 18:09:18.574269 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e7172c79-41b6-4ff7-a0f0-87b3b3fa2ff5 req-1f5e930c-ebcd-460b-bd7e-b2ce87b20834 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0519581 Feb 17 18:09:19.231848 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebda2270-5636-42c3-b81f-b64f1913662d req-6dd88fd5-88c0-4dad-a587-34eb232728b5 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:19.233454 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ebda2270-5636-42c3-b81f-b64f1913662d req-6dd88fd5-88c0-4dad-a587-34eb232728b5 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1987944 Feb 17 18:09:19.240719 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fda20d2-d6fd-447d-9958-9999917a22d8 req-6540b39d-1915-419e-8282-8d45146df553 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:19.242299 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3fda20d2-d6fd-447d-9958-9999917a22d8 req-6540b39d-1915-419e-8282-8d45146df553 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.1638849 Feb 17 18:09:19.320605 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ebda2270-5636-42c3-b81f-b64f1913662d req-38d21430-4379-44ba-993e-bfec7d5bb709 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772831 Feb 17 18:09:19.325259 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3fda20d2-d6fd-447d-9958-9999917a22d8 req-219480e5-6b7a-4b1f-b328-561f079f4037 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656686 Feb 17 18:09:19.824230 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ade200b3-f719-4b16-8ed1-3f0587e6163a req-009fd665-ac37-49fb-a5bd-52758f30c189 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:19.832423 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ade200b3-f719-4b16-8ed1-3f0587e6163a req-009fd665-ac37-49fb-a5bd-52758f30c189 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0973430 Feb 17 18:09:19.893713 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ade200b3-f719-4b16-8ed1-3f0587e6163a req-dc0f306b-0dbd-41e3-8839-b5d630691715 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0600109 Feb 17 18:09:20.784489 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0ccb8f7-9df9-4a36-8be3-64a0e889cbcf req-6908b169-a4e4-4a7c-b1a6-577533798557 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:20.793159 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e0ccb8f7-9df9-4a36-8be3-64a0e889cbcf req-6908b169-a4e4-4a7c-b1a6-577533798557 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.2815199 Feb 17 18:09:20.862579 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad1edc78-bfeb-4477-a6cb-c90f39e3f8ce req-942324b7-5574-49d9-94b4-7d990d2ad793 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:20.875587 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ad1edc78-bfeb-4477-a6cb-c90f39e3f8ce req-942324b7-5574-49d9-94b4-7d990d2ad793 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.3150883 Feb 17 18:09:20.949371 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e0ccb8f7-9df9-4a36-8be3-64a0e889cbcf req-a63f1104-a404-4ac8-8858-2e7784f85a3d tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1543150 Feb 17 18:09:20.988013 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ad1edc78-bfeb-4477-a6cb-c90f39e3f8ce req-9eb21a76-accb-4fa4-9f5f-7175563d39e9 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1100602 Feb 17 18:09:21.265146 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f312f21-5d87-4d4e-8f13-ecd2186bc5df req-67dd0f36-18ce-4d15-bb35-de34c6892530 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:21.266819 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7f312f21-5d87-4d4e-8f13-ecd2186bc5df req-67dd0f36-18ce-4d15-bb35-de34c6892530 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1437545 Feb 17 18:09:21.360804 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7f312f21-5d87-4d4e-8f13-ecd2186bc5df req-498e679c-9d8e-4cb9-851b-64ec5fc8dcc1 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0833867 Feb 17 18:09:22.203132 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10206908-ae47-4986-ae3b-3ea1e598a421 req-339b82a8-6ab9-493e-9a86-6b9e8e603aa2 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:22.206970 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-10206908-ae47-4986-ae3b-3ea1e598a421 req-339b82a8-6ab9-493e-9a86-6b9e8e603aa2 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.1356602 Feb 17 18:09:22.318115 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-10206908-ae47-4986-ae3b-3ea1e598a421 req-5c061959-1e03-4ec5-9da0-a0a1a2a97f63 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1101241 Feb 17 18:09:22.377723 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-769802f8-d6d5-4bca-bfd5-165fece669d4 req-5c23110f-4b9f-4636-a096-9ab6369e0586 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:22.380453 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-769802f8-d6d5-4bca-bfd5-165fece669d4 req-5c23110f-4b9f-4636-a096-9ab6369e0586 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1697764 Feb 17 18:09:22.464554 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-769802f8-d6d5-4bca-bfd5-165fece669d4 req-02cde74d-a961-4ffc-b507-7609b76d10b5 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768781 Feb 17 18:09:22.612251 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e193c0b5-3cc8-4afe-af33-80af9aef971e req-df1149ab-222a-4d78-9f34-ab1ad8eeb2ff tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:22.614504 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e193c0b5-3cc8-4afe-af33-80af9aef971e req-df1149ab-222a-4d78-9f34-ab1ad8eeb2ff tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0991917 Feb 17 18:09:22.675478 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e193c0b5-3cc8-4afe-af33-80af9aef971e req-320c2380-b140-4e14-94ca-1551caf33fba tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479093 Feb 17 18:09:23.570977 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-101fc06a-dcb2-4893-8b84-f970b4e3e308 req-fb593d02-883a-4525-938e-57186ab7f51b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:23.577203 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-101fc06a-dcb2-4893-8b84-f970b4e3e308 req-fb593d02-883a-4525-938e-57186ab7f51b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.1254814 Feb 17 18:09:23.737420 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-101fc06a-dcb2-4893-8b84-f970b4e3e308 req-41b23320-db9c-4463-b3b7-fb8dfadf74df tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1520870 Feb 17 18:09:23.956259 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0ed6221-8a08-4b11-81c6-995f5edde87b req-c150d083-73f3-4d1d-aa5c-227bd5e55957 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:23.979431 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c0ed6221-8a08-4b11-81c6-995f5edde87b req-c150d083-73f3-4d1d-aa5c-227bd5e55957 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.2389529 Feb 17 18:09:24.223367 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c0ed6221-8a08-4b11-81c6-995f5edde87b req-18e42d64-d470-45f7-b9ba-3ccb4de5c404 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2404101 Feb 17 18:09:24.311593 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb4e1f32-36b1-4e91-b460-14605878825b req-c081bf11-b942-430a-b721-e1e6578dee41 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:24.321901 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cb4e1f32-36b1-4e91-b460-14605878825b req-c081bf11-b942-430a-b721-e1e6578dee41 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.2748303 Feb 17 18:09:24.409729 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cb4e1f32-36b1-4e91-b460-14605878825b req-c1179a16-21d7-442e-8803-dc6028f3a05c tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0836711 Feb 17 18:09:25.022353 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a126a2a-67b5-4c65-817c-22f216553c9c req-f6580a38-2c5d-4e54-8272-e7fdc6faa63b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:25.024178 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8a126a2a-67b5-4c65-817c-22f216553c9c req-f6580a38-2c5d-4e54-8272-e7fdc6faa63b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.1063428 Feb 17 18:09:25.113389 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8a126a2a-67b5-4c65-817c-22f216553c9c req-7edd649d-df18-4390-91e2-a9c32751cc55 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747414 Feb 17 18:09:25.598135 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cb74c00-f739-49fe-bd11-dcaa24a3797e req-259926d7-a74a-4f81-b7e6-008654b54d93 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:25.717117 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2cb74c00-f739-49fe-bd11-dcaa24a3797e req-259926d7-a74a-4f81-b7e6-008654b54d93 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.2092063 Feb 17 18:09:25.725232 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2cb74c00-f739-49fe-bd11-dcaa24a3797e req-9328f76a-3aea-4790-b97f-19cf2f4bebc4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659606 Feb 17 18:09:25.743823 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f983849d-6d42-4226-b04a-a514f3f1bc71 req-01192e89-d47f-44c4-a11f-b2c02b122436 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:25.745448 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f983849d-6d42-4226-b04a-a514f3f1bc71 req-01192e89-d47f-44c4-a11f-b2c02b122436 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1311111 Feb 17 18:09:25.861090 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f983849d-6d42-4226-b04a-a514f3f1bc71 req-55c2f0e2-2f4e-4ad0-940e-fc48c013c2b0 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1085055 Feb 17 18:09:27.207080 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e3c818-951e-448c-b304-687a70e09109 req-6a4b60f0-41f2-4295-902a-86977c0513eb tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:27.209425 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-28e3c818-951e-448c-b304-687a70e09109 req-6a4b60f0-41f2-4295-902a-86977c0513eb tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1450627 Feb 17 18:09:27.215985 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43eab14f-89ba-40d3-ba66-0be072b98151 req-725a839d-b780-495e-a168-adbec24ad9d0 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:27.217849 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-43eab14f-89ba-40d3-ba66-0be072b98151 req-725a839d-b780-495e-a168-adbec24ad9d0 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.2278659 Feb 17 18:09:27.291964 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-28e3c818-951e-448c-b304-687a70e09109 req-036a094f-cf42-4de6-9765-ac0e0f47983f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698528 Feb 17 18:09:27.313311 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-43eab14f-89ba-40d3-ba66-0be072b98151 req-ee372a93-92c6-4aea-9d84-1408b52f1450 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602827 Feb 17 18:09:27.571337 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3377a1b-f380-4c10-931f-bc513223a917 req-40dd4877-357f-4e09-ae65-48dd06c63697 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:27.574509 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d3377a1b-f380-4c10-931f-bc513223a917 req-40dd4877-357f-4e09-ae65-48dd06c63697 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1226134 Feb 17 18:09:27.631457 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d3377a1b-f380-4c10-931f-bc513223a917 req-528d4814-907a-40eb-b159-37237dbab17b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0557125 Feb 17 18:09:28.583278 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-639a0fb2-b3ee-4deb-bf27-c7fac224f51c req-c73a255d-26d0-4e28-8dba-ddc5587c7df0 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:28.593653 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-639a0fb2-b3ee-4deb-bf27-c7fac224f51c req-c73a255d-26d0-4e28-8dba-ddc5587c7df0 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1711254 Feb 17 18:09:28.644528 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7128bbb4-43e3-4582-86bb-82ce56702d57 req-14f13e9d-926e-4ddc-b884-ae57d4f71943 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:28.646699 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7128bbb4-43e3-4582-86bb-82ce56702d57 req-14f13e9d-926e-4ddc-b884-ae57d4f71943 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.1686041 Feb 17 18:09:28.656475 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-639a0fb2-b3ee-4deb-bf27-c7fac224f51c req-43c755bc-040b-4b46-9085-8def938b0e63 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644400 Feb 17 18:09:28.709753 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7128bbb4-43e3-4582-86bb-82ce56702d57 req-ea6cc498-2238-47d4-844b-71be73bb4f2e tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519159 Feb 17 18:09:28.851834 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c0c442-a4bc-4575-a0c8-563893259b59 req-118f28bd-d87e-461e-940a-7db98a06b6cf tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:28.853396 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-69c0c442-a4bc-4575-a0c8-563893259b59 req-118f28bd-d87e-461e-940a-7db98a06b6cf tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0895648 Feb 17 18:09:28.905853 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-69c0c442-a4bc-4575-a0c8-563893259b59 req-61f7d0a7-e0d1-4c5d-ade1-d9dd1075e060 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455060 Feb 17 18:09:29.960171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18b5ba9-a30d-41fc-be14-dbf7d0f57b74 req-1e4f7800-73dc-4834-aa84-baee2e9ca97e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:29.961801 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e18b5ba9-a30d-41fc-be14-dbf7d0f57b74 req-1e4f7800-73dc-4834-aa84-baee2e9ca97e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1678348 Feb 17 18:09:29.973401 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e7e0583-e1fe-46c6-8025-a50e73950528 req-08bbe742-28d2-4621-b2f0-571ef9510a57 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:29.974947 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4e7e0583-e1fe-46c6-8025-a50e73950528 req-08bbe742-28d2-4621-b2f0-571ef9510a57 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.1171043 Feb 17 18:09:30.048210 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e18b5ba9-a30d-41fc-be14-dbf7d0f57b74 req-d265a4c1-6b23-4c76-a03a-69d7766ea967 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721700 Feb 17 18:09:30.056475 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4e7e0583-e1fe-46c6-8025-a50e73950528 req-848df44f-07a0-4967-be10-db14a5fb6374 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659595 Feb 17 18:09:30.258451 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57a80ca-3109-4a6f-acbe-d9d490f5246b req-f30d0ab4-2865-4a43-862e-371aa52e64aa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:30.260144 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b57a80ca-3109-4a6f-acbe-d9d490f5246b req-f30d0ab4-2865-4a43-862e-371aa52e64aa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0894094 Feb 17 18:09:30.314260 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b57a80ca-3109-4a6f-acbe-d9d490f5246b req-74a39a68-1f19-436c-b5df-eaabf03157bf tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463500 Feb 17 18:09:31.453611 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9fd7d09-2ab1-4a8a-a96d-118f479710ed req-ec605352-f8b2-4161-8f1a-f2230dccdb78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:31.455266 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a9fd7d09-2ab1-4a8a-a96d-118f479710ed req-ec605352-f8b2-4161-8f1a-f2230dccdb78 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=5729c656e2c64606a663d6434a5c3973&device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 1160 time: 0.0803344 Feb 17 18:09:31.799708 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fcb6f2f-623b-49f6-84e2-3d54c395db89 req-8cc09604-28ab-4951-a477-fec1d7ad3974 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:31.805626 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 57824) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:09:31.808595 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6fcb6f2f-623b-49f6-84e2-3d54c395db89 req-8cc09604-28ab-4951-a477-fec1d7ad3974 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.2889974 Feb 17 18:09:31.838051 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22bc43ec-16bd-41bf-aeb9-57305a4efb2a req-725b3beb-017f-42db-9a1b-2660c842c2e7 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:31.839784 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-22bc43ec-16bd-41bf-aeb9-57305a4efb2a req-725b3beb-017f-42db-9a1b-2660c842c2e7 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.2627399 Feb 17 18:09:31.894086 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6fcb6f2f-623b-49f6-84e2-3d54c395db89 req-60a3207c-cdf1-4a13-a25d-273e57873c1e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0842762 Feb 17 18:09:31.968941 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-22bc43ec-16bd-41bf-aeb9-57305a4efb2a req-d025e149-6a67-4680-8716-373004520bb9 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1121740 Feb 17 18:09:31.987706 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c72c98df-f834-4f8d-87b4-40c342896f1d admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:32.026514 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c72c98df-f834-4f8d-87b4-40c342896f1d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:09:32.029993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c72c98df-f834-4f8d-87b4-40c342896f1d admin admin] Usage tracker for resource:security_group_rule and tenant:8b706832d26847838c491b08bad6515a is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:09:32.036312 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-c72c98df-f834-4f8d-87b4-40c342896f1d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:09:32.044552 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-c72c98df-f834-4f8d-87b4-40c342896f1d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:09:32.140323 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c72c98df-f834-4f8d-87b4-40c342896f1d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:32.141588 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1983ff1-890d-4287-afe3-4953331a5595 req-3988417e-6b81-48bb-a60c-5b2b6488611d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:32.143314 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a1983ff1-890d-4287-afe3-4953331a5595 req-3988417e-6b81-48bb-a60c-5b2b6488611d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0941811 Feb 17 18:09:32.181509 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c72c98df-f834-4f8d-87b4-40c342896f1d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:32.191105 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7d42dff9-c622-4482-b1e7-9541b8b8b10f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:32.196650 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a1983ff1-890d-4287-afe3-4953331a5595 req-5f4f48a9-2455-496c-9e09-1cbad52f48de tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463135 Feb 17 18:09:32.239827 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c72c98df-f834-4f8d-87b4-40c342896f1d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8b706832d26847838c491b08bad6515a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4327133 Feb 17 18:09:32.241059 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c72c98df-f834-4f8d-87b4-40c342896f1d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40ec8f8a-8bbe-4209-b27c-c1f52aa1ae8b,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:32.242647 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 57836) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:09:32.244923 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c72c98df-f834-4f8d-87b4-40c342896f1d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:32.321974 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a540350b-5663-489a-93dc-a63b82db2574 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:32.352063 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a540350b-5663-489a-93dc-a63b82db2574 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:32.510682 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a540350b-5663-489a-93dc-a63b82db2574 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:32.515964 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-91ed150d-7cd7-4acc-bf44-d7fef03f6ebc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:32.532563 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a540350b-5663-489a-93dc-a63b82db2574 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40ec8f8a-8bbe-4209-b27c-c1f52aa1ae8b,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:32.535417 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a540350b-5663-489a-93dc-a63b82db2574 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:32.546065 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a540350b-5663-489a-93dc-a63b82db2574 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:32.546065 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-a540350b-5663-489a-93dc-a63b82db2574 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/40ec8f8a-8bbe-4209-b27c-c1f52aa1ae8b HTTP/1.1" status: 204 len: 168 time: 0.2977242 Feb 17 18:09:33.179259 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca883f67-a4d7-4cf9-99d0-6d21b6138703 req-274b4383-d6bc-42a1-91d9-c27855820b0a tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:33.183665 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ca883f67-a4d7-4cf9-99d0-6d21b6138703 req-274b4383-d6bc-42a1-91d9-c27855820b0a tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1654031 Feb 17 18:09:33.303605 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ca883f67-a4d7-4cf9-99d0-6d21b6138703 req-efee6590-70a0-44cd-b782-6924ec1019c8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770721 Feb 17 18:09:33.317684 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93e27818-7224-40bc-a243-3dfce0a4547b req-9e7408e2-09c4-45f6-8019-7a55632a9078 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:33.319268 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-93e27818-7224-40bc-a243-3dfce0a4547b req-9e7408e2-09c4-45f6-8019-7a55632a9078 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.1605921 Feb 17 18:09:33.369399 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-93e27818-7224-40bc-a243-3dfce0a4547b req-1fecb769-6c32-4fd6-8cd6-54a014bd516d tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422730 Feb 17 18:09:33.496010 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12916ef3-daba-41ca-9c45-8ef035c407e3 req-54fb35c7-a489-46d3-a279-7317ff2b67be tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:33.497605 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-12916ef3-daba-41ca-9c45-8ef035c407e3 req-54fb35c7-a489-46d3-a279-7317ff2b67be tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0857890 Feb 17 18:09:33.547776 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-12916ef3-daba-41ca-9c45-8ef035c407e3 req-7167ecdb-62c3-49fa-8c47-e8a1368bea0a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438037 Feb 17 18:09:34.300966 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 57866) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:09:34.330825 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9fd7d09-2ab1-4a8a-a96d-118f479710ed req-981acb00-939b-46f8-a8e0-5c066ca218d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:34.333170 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a9fd7d09-2ab1-4a8a-a96d-118f479710ed req-981acb00-939b-46f8-a8e0-5c066ca218d0 service neutron] 10.222.0.70 "GET /v2.0/networks?tenant_id=5729c656e2c64606a663d6434a5c3973&shared=False HTTP/1.1" status: 200 len: 909 time: 0.1528046 Feb 17 18:09:34.372715 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_v2 [None req-252090c6-9045-43c0-a669-869f0c0ad0b4 admin admin] Deleting subnet 454e1bd3-ed8a-471d-bca5-14fd752ac4a6 {{(pid=84112) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1041}} Feb 17 18:09:34.376320 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-252090c6-9045-43c0-a669-869f0c0ad0b4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:34.439507 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-252090c6-9045-43c0-a669-869f0c0ad0b4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036852617770'] for subnet, precommit_delete_associations {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:34.503931 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-252090c6-9045-43c0-a669-869f0c0ad0b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1550982'] for subnet, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:34.813988 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9fd7d09-2ab1-4a8a-a96d-118f479710ed req-aa343a3f-771f-48c6-b2bd-0f25e1cce0fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:34.815545 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a9fd7d09-2ab1-4a8a-a96d-118f479710ed req-aa343a3f-771f-48c6-b2bd-0f25e1cce0fa service neutron] 10.222.0.70 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 863 time: 0.4726570 Feb 17 18:09:34.830932 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff516418-7ee3-409a-8f4b-198bb00492e4 req-124dfe17-29d1-4a2a-ba27-4bfde166b3c7 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:34.832545 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ff516418-7ee3-409a-8f4b-198bb00492e4 req-124dfe17-29d1-4a2a-ba27-4bfde166b3c7 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.2717354 Feb 17 18:09:34.839653 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a41bc6d9-fcee-46b1-9635-1cc6826e391d req-280e23a0-85ed-4bfd-8fee-433c36d38683 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:34.841440 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a41bc6d9-fcee-46b1-9635-1cc6826e391d req-280e23a0-85ed-4bfd-8fee-433c36d38683 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.2791917 Feb 17 18:09:34.974540 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ff516418-7ee3-409a-8f4b-198bb00492e4 req-9dd3d23a-47ae-4176-85b5-0961df6bf218 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1320622 Feb 17 18:09:34.984857 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a41bc6d9-fcee-46b1-9635-1cc6826e391d req-28912c6f-1f1e-4235-a569-ba16f8d15d1d tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1276758 Feb 17 18:09:35.008200 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-252090c6-9045-43c0-a669-869f0c0ad0b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853224802', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted--9223372036852540111', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete--9223372036850851564'] for subnet, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:35.017752 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-ada57281-7454-43d1-ade8-d5949a930152 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:35.019628 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-ada57281-7454-43d1-ade8-d5949a930152 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=5729c656e2c64606a663d6434a5c3973&device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 1160 time: 0.1414211 Feb 17 18:09:35.027878 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3d11bf27-0b8f-4b20-97ac-ce7a95769862 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:35.107845 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-afeea84f-4538-41a0-99d9-b1069357781b service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 217 time: 0.0708101 Feb 17 18:09:35.108241 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-252090c6-9045-43c0-a669-869f0c0ad0b4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=454e1bd3-ed8a-471d-bca5-14fd752ac4a6,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:35.121865 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-252090c6-9045-43c0-a669-869f0c0ad0b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:35.166266 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-252090c6-9045-43c0-a669-869f0c0ad0b4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for subnet, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:35.185023 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-252090c6-9045-43c0-a669-869f0c0ad0b4 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/454e1bd3-ed8a-471d-bca5-14fd752ac4a6 HTTP/1.1" status: 204 len: 168 time: 0.8805497 Feb 17 18:09:35.185302 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 57892) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:09:35.248583 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-308b32ae-d76c-4d91-af47-e43eb3000879 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:35.250166 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-308b32ae-d76c-4d91-af47-e43eb3000879 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=8a96f440-286f-407f-9d7e-b3b2727a69a9 HTTP/1.1" status: 200 len: 854 time: 0.0930021 Feb 17 18:09:35.308957 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1376323'] for network, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:35.322938 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b2603f5-34c0-4a80-88be-9938ce2bcf15 req-ac67e63c-b89d-482a-bac7-4d5490b27af7 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:35.324849 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4b2603f5-34c0-4a80-88be-9938ce2bcf15 req-ac67e63c-b89d-482a-bac7-4d5490b27af7 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.2093792 Feb 17 18:09:35.392022 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-516cc1f0-2661-4356-a631-6dede1233633 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:35.393668 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-516cc1f0-2661-4356-a631-6dede1233633 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=6755b14b-f6f6-43aa-a697-3921175c5230&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1350918 Feb 17 18:09:35.398515 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4b2603f5-34c0-4a80-88be-9938ce2bcf15 req-38fefc79-1f66-4593-baf5-7e36fa063b19 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0646229 Feb 17 18:09:35.534712 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1551647', 'neutron.services.segments.db._delete_segments_for_network-8730056716045'] for network, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:35.583108 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-c11ca584-4be8-4992-8795-c6ae044a8097 service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1671810 Feb 17 18:09:35.716537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1800276f-b949-479f-aed9-1f68503c0afc']}} {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:09:35.734445 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a45af54e-2b36-4f06-9307-68aa94af437e') {'for_net_delete': True} {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:09:35.734941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a45af54e-2b36-4f06-9307-68aa94af437e') {} {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:09:35.748111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8730056711181', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2158030'] for segment, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:35.767980 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:35.770888 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] Releasing vxlan tunnel 7 to pool {{(pid=84112) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:322}} Feb 17 18:09:35.798007 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-90e97bdb-5272-40cb-9fc8-73eb5ee81e86 req-71279440-68e5-4d8f-b0fb-11022793884d service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2070551 Feb 17 18:09:36.262049 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] Network 1800276f-b949-479f-aed9-1f68503c0afc has no segments {{(pid=84112) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:09:36.273009 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1547159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2235342'] for segment, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:36.300672 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14654074-1016-4874-a49d-e53193f93643 req-0078177a-cfbf-477c-acc6-a8646bd9740e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:36.309925 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-14654074-1016-4874-a49d-e53193f93643 req-0078177a-cfbf-477c-acc6-a8646bd9740e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1899142 Feb 17 18:09:36.345220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f94632ee-083d-48b9-9c06-51f3de14768c req-38a5ab1c-ed41-47ea-9c33-fa87e7fb92fe tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:36.347327 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f94632ee-083d-48b9-9c06-51f3de14768c req-38a5ab1c-ed41-47ea-9c33-fa87e7fb92fe tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.1825867 Feb 17 18:09:36.434085 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-14654074-1016-4874-a49d-e53193f93643 req-ba3e2fdd-fca3-4447-b884-892b1a6eac16 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0954797 Feb 17 18:09:36.438765 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f94632ee-083d-48b9-9c06-51f3de14768c req-3b64c28b-f3e5-4817-bee0-da84e4912f6b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703821 Feb 17 18:09:36.512605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] Network 1800276f-b949-479f-aed9-1f68503c0afc has no segments {{(pid=84112) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: Traceback (most recent call last): Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: timer() Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: cb(*args, **kw) Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/common/utils.py", line 973, in wrapper Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: return func(*args, **kwargs) Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: self._notify() Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: self.callback(batched_events) Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: event.method(event) Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: segment_id)['aggregates'][0] Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: return f(self, *a, **k) Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: return self._get(url).json() Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: **kwargs) Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1131, in get Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: return self.request(url, 'GET', **kwargs) Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 802, in request Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: **endpoint_filter) Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 17 18:09:36.557561 dv-cinder-760194-3-iscsi neutron-server[84000]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 17 18:09:36.736501 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88fa7d39-fe5d-4078-a396-3818f8cd0f27 req-3a2fbff2-a383-4dd4-88e8-d8735c0ba9b0 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:36.738119 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-88fa7d39-fe5d-4078-a396-3818f8cd0f27 req-3a2fbff2-a383-4dd4-88e8-d8735c0ba9b0 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1942909 Feb 17 18:09:36.781731 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853224169', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036854319422'] for network, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:36.787682 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:36.801332 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-88fa7d39-fe5d-4078-a396-3818f8cd0f27 req-91fb7e07-c2fe-44b7-af9d-6390a643ea6d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0549905 Feb 17 18:09:36.817301 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] Pushing event deleted for resources: {'Network': ['ID=1800276f-b949-479f-aed9-1f68503c0afc,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:36.820680 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:36.826686 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:36.865792 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-924ada64-1c0e-4f16-b50d-b082cc5d3942 admin admin] 10.222.0.13 "DELETE /v2.0/networks/1800276f-b949-479f-aed9-1f68503c0afc HTTP/1.1" status: 204 len: 168 time: 1.6793644 Feb 17 18:09:37.184490 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 57916) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:09:37.245810 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-451d3f2d-6ce1-43c8-aa24-abc575518604 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b1cf694474c0491d93d574af2b2bceeb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0598853 Feb 17 18:09:37.248503 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 57920) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:09:37.318599 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0f13713b-0503-4831-b6ad-19ae4f94d7f5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:37.349708 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0f13713b-0503-4831-b6ad-19ae4f94d7f5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:37.437657 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0f13713b-0503-4831-b6ad-19ae4f94d7f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:37.446200 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:37.461104 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f13713b-0503-4831-b6ad-19ae4f94d7f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70055f11-c17a-47be-b4e0-6020a600ddc5,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:37.465023 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0f13713b-0503-4831-b6ad-19ae4f94d7f5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:37.469516 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-0f13713b-0503-4831-b6ad-19ae4f94d7f5 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/70055f11-c17a-47be-b4e0-6020a600ddc5 HTTP/1.1" status: 204 len: 168 time: 0.2172577 Feb 17 18:09:37.469516 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0f13713b-0503-4831-b6ad-19ae4f94d7f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:37.687916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-dba1dff0-e714-4552-9dc1-bcef9129b6d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:37.842711 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d99846c-9486-41da-91a3-d08ec5e6f40c req-7d62a206-22e2-4645-a60d-735d33da3790 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:37.848223 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7d99846c-9486-41da-91a3-d08ec5e6f40c req-7d62a206-22e2-4645-a60d-735d33da3790 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.1588848 Feb 17 18:09:37.901345 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb531872-918e-4d55-88f3-bccf14c3d00f req-43239afe-81e5-4a59-a767-fbc2865b1d56 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:37.903075 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bb531872-918e-4d55-88f3-bccf14c3d00f req-43239afe-81e5-4a59-a767-fbc2865b1d56 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.2960496 Feb 17 18:09:37.911908 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7d99846c-9486-41da-91a3-d08ec5e6f40c req-9a6a4f63-7c9f-490b-aa85-52bd1e0e467a tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0627692 Feb 17 18:09:37.975155 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-bb531872-918e-4d55-88f3-bccf14c3d00f req-3ff93d88-cb97-4591-a134-92dedd562b1c tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606427 Feb 17 18:09:38.100228 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.objects.ports [None req-6ba17194-22b0-4fe5-8636-ba03bcc3c94a None None] Time-cost: Fetching 1 ports in 1 security groups {{(pid=84113) get_objects /opt/stack/neutron/neutron/objects/ports.py:431}} Feb 17 18:09:38.209730 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74001a37-8016-4f98-a57c-c90aa71d38b7 req-e62f2b59-5ef5-41a2-9d41-c4b4c39cf002 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:38.218297 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-74001a37-8016-4f98-a57c-c90aa71d38b7 req-e62f2b59-5ef5-41a2-9d41-c4b4c39cf002 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1311319 Feb 17 18:09:38.289242 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-74001a37-8016-4f98-a57c-c90aa71d38b7 req-8a32d93c-dfee-4ec4-88e6-9725cb526bb3 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0655017 Feb 17 18:09:38.959403 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e5b8b8b3-6466-4164-8a2d-7627684ce9d0 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:09:39.258542 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e44ed4b9-2121-4029-8271-ee9bc77c09d8 req-c261618e-ab16-45ff-83ef-54cdd3e23662 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:39.260399 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e44ed4b9-2121-4029-8271-ee9bc77c09d8 req-c261618e-ab16-45ff-83ef-54cdd3e23662 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 943 time: 0.2001729 Feb 17 18:09:39.294334 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9ed602f-4369-4121-b5f9-81614862d05d req-150c032b-87e6-47a6-99bf-24232c2fb890 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:39.295917 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d9ed602f-4369-4121-b5f9-81614862d05d req-150c032b-87e6-47a6-99bf-24232c2fb890 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1585107 Feb 17 18:09:39.320225 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning for port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:09:39.330570 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:09:39.331912 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:39.361092 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d9ed602f-4369-4121-b5f9-81614862d05d req-ade672be-375e-4d43-b875-e298d8774959 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570703 Feb 17 18:09:39.363787 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e44ed4b9-2121-4029-8271-ee9bc77c09d8 req-cdd7b455-6091-4c76-8512-b12766b05342 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0946252 Feb 17 18:09:39.771684 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dff041d-c044-4633-bead-ff0f615da96e req-6c5a71c8-0c7b-455c-8fe0-49e833ef2104 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:39.772847 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:39.773566 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8dff041d-c044-4633-bead-ff0f615da96e req-6c5a71c8-0c7b-455c-8fe0-49e833ef2104 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.2670865 Feb 17 18:09:39.888293 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:09:39.900599 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port e5b8b8b3-6466-4164-8a2d-7627684ce9d0, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0,segment=NetworkSegment(26bc7590-668d-4f62-883e-3f8e0fb997b0),segment_id=26bc7590-668d-4f62-883e-3f8e0fb997b0)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:09:39.906242 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8dff041d-c044-4633-bead-ff0f615da96e req-23064ae5-e1e6-4f75-b61f-60c8a0dd35a1 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1220963 Feb 17 18:09:39.939447 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:39.940402 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:09:40.053920 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b57787c3-c5a4-4818-b275-a6515e47c1ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:40.059133 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:40.184158 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0', 'code': 200} Feb 17 18:09:40.185452 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=e5b8b8b3-6466-4164-8a2d-7627684ce9d0,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:40.189152 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:40.205328 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:09:40.206199 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:40.610927 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e5b8b8b3-6466-4164-8a2d-7627684ce9d0 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:09:40.748526 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6e3b38-2d77-4e6e-9d34-a27deacbd93e req-ab90faaa-eb5d-4101-b8ff-3fb6d6f79659 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:40.750550 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4b6e3b38-2d77-4e6e-9d34-a27deacbd93e req-ab90faaa-eb5d-4101-b8ff-3fb6d6f79659 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 1162 time: 0.3019302 Feb 17 18:09:40.760481 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a89faa-04af-40cc-afe9-6b5df4cf98c1 req-b0b7f289-c31d-474b-b8e9-d1ec5b026f3f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:40.763055 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94a89faa-04af-40cc-afe9-6b5df4cf98c1 req-b0b7f289-c31d-474b-b8e9-d1ec5b026f3f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1525478 Feb 17 18:09:40.768480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:09:40.768656 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:40.830369 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57dea88-0fdf-4921-9d9b-4281a3b51a80 req-45b67842-830e-4e01-b205-a74e598034af tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:40.838517 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f57dea88-0fdf-4921-9d9b-4281a3b51a80 req-45b67842-830e-4e01-b205-a74e598034af tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.3071356 Feb 17 18:09:40.889973 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:40.905633 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4b6e3b38-2d77-4e6e-9d34-a27deacbd93e req-94c33edb-2f4d-4fd8-bcc5-4d1ab8b6a0ed service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1411085 Feb 17 18:09:40.942811 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94a89faa-04af-40cc-afe9-6b5df4cf98c1 req-b4230955-a213-4dba-a6aa-0486b1be24f0 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1617916 Feb 17 18:09:40.973217 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f57dea88-0fdf-4921-9d9b-4281a3b51a80 req-32518a6a-3482-4c5c-aba7-7f29d6a34bb4 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1326206 Feb 17 18:09:40.993542 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:09:41.104678 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port c3de3799-da31-433f-9203-bfbce68f8d59 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:09:41.105270 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:41.239580 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-403db52b-c34a-4660-938f-e887c84d9626 req-022216a5-5443-431d-946e-69d306d39141 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:41.245186 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-403db52b-c34a-4660-938f-e887c84d9626 req-022216a5-5443-431d-946e-69d306d39141 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1567528 Feb 17 18:09:41.310782 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-403db52b-c34a-4660-938f-e887c84d9626 req-5c2f6128-c1d3-4058-ba1d-bb2412475e67 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0567813 Feb 17 18:09:41.891251 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ea32f15b-7483-44f1-ae0c-c9a2e5ae98b0 req-5355e6fa-af9d-4a84-a5eb-0a767a5efb98 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 272 time: 0.1214817 Feb 17 18:09:42.044386 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea32f15b-7483-44f1-ae0c-c9a2e5ae98b0 req-89e9e03e-808f-4dc3-a029-6c2117a0d940 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:42.046030 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ea32f15b-7483-44f1-ae0c-c9a2e5ae98b0 req-89e9e03e-808f-4dc3-a029-6c2117a0d940 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 1162 time: 0.1251647 Feb 17 18:09:42.568148 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:09:42.739291 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port c3de3799-da31-433f-9203-bfbce68f8d59 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:09:42.740007 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:42.785847 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad19d512-3c4f-4955-9ab3-3f9a1e467bac req-2945d3a8-c7ac-42ce-a786-5eb836ce7e14 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:42.787410 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ad19d512-3c4f-4955-9ab3-3f9a1e467bac req-2945d3a8-c7ac-42ce-a786-5eb836ce7e14 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.4934764 Feb 17 18:09:42.793129 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea32f15b-7483-44f1-ae0c-c9a2e5ae98b0 req-00eed3f6-bb90-447d-bd15-6ef8d1cfe235 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:42.794790 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ea32f15b-7483-44f1-ae0c-c9a2e5ae98b0 req-00eed3f6-bb90-447d-bd15-6ef8d1cfe235 service neutron] 10.222.0.70 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 913 time: 0.7166088 Feb 17 18:09:42.800975 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3892e26-6c0d-4cf9-a915-3ec6ba53a2d1 req-fbf10cec-b28b-4ec3-8f00-3eada7c33f10 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:42.802529 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e3892e26-6c0d-4cf9-a915-3ec6ba53a2d1 req-fbf10cec-b28b-4ec3-8f00-3eada7c33f10 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.5073726 Feb 17 18:09:42.911197 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ea32f15b-7483-44f1-ae0c-c9a2e5ae98b0 req-e82565f4-0970-4034-a155-cc45736e9e60 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=bb98aa49-1c81-4cea-99cf-f201d19cfdae HTTP/1.1" status: 200 len: 217 time: 0.1062183 Feb 17 18:09:43.000489 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e3892e26-6c0d-4cf9-a915-3ec6ba53a2d1 req-93814fdb-0ed2-4828-8d42-917710db889e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1245632 Feb 17 18:09:43.009312 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ad19d512-3c4f-4955-9ab3-3f9a1e467bac req-42e7bc38-b7ff-4dd0-b969-e3979991d5e9 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2057953 Feb 17 18:09:43.020921 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea32f15b-7483-44f1-ae0c-c9a2e5ae98b0 req-fe5b4659-c6f8-4d2f-9ec1-155a3749b19c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:43.022664 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ea32f15b-7483-44f1-ae0c-c9a2e5ae98b0 req-fe5b4659-c6f8-4d2f-9ec1-155a3749b19c service neutron] 10.222.0.70 "GET /v2.0/subnets?id=c04f01da-1295-4b8a-95ae-46589cb07040 HTTP/1.1" status: 200 len: 859 time: 0.1032534 Feb 17 18:09:43.076713 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ea32f15b-7483-44f1-ae0c-c9a2e5ae98b0 req-2d87aa32-89cd-4acb-97b9-7944b5ff289b service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4aaf4a03-4480-421f-bff4-f9814e969001&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0467012 Feb 17 18:09:43.292218 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ea32f15b-7483-44f1-ae0c-c9a2e5ae98b0 req-7ad8a029-3350-4869-af66-57e47794b422 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2071254 Feb 17 18:09:43.299367 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3878f182-ff71-48ce-ab93-77052bcf6bf1 req-1694197d-5aa9-4e9f-8139-c7461a2e18b0 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:43.301442 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3878f182-ff71-48ce-ab93-77052bcf6bf1 req-1694197d-5aa9-4e9f-8139-c7461a2e18b0 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1917489 Feb 17 18:09:43.445551 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3878f182-ff71-48ce-ab93-77052bcf6bf1 req-2cd221c7-76fb-4cb1-b010-60061fe7cf6e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1214585 Feb 17 18:09:43.484627 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ea32f15b-7483-44f1-ae0c-c9a2e5ae98b0 req-008bda39-20cf-4dd4-8f2d-cf8d4ae71084 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1821980 Feb 17 18:09:44.293832 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5a2286-80ca-43db-a3b9-d49ea63afb28 req-c2b06d4d-59c6-418a-b39e-9a2ea240ba0b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:44.295443 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7b5a2286-80ca-43db-a3b9-d49ea63afb28 req-c2b06d4d-59c6-418a-b39e-9a2ea240ba0b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1620803 Feb 17 18:09:44.303834 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0fd175-5d8a-4b1c-9353-3a23357863d7 req-d0820455-0e3b-49b4-844f-ba45ecb51df3 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:44.305410 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ab0fd175-5d8a-4b1c-9353-3a23357863d7 req-d0820455-0e3b-49b4-844f-ba45ecb51df3 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.1697974 Feb 17 18:09:44.380665 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7b5a2286-80ca-43db-a3b9-d49ea63afb28 req-798001cb-560e-45a5-b82a-55f650929e59 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741739 Feb 17 18:09:44.383467 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ab0fd175-5d8a-4b1c-9353-3a23357863d7 req-74f89ac8-5392-4eb6-bccc-688d11f57343 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630362 Feb 17 18:09:44.676238 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8708cae8-e3ea-4ca0-84b9-f68ef4a4e53d req-36f525ad-d901-4aec-9569-9eda118b651f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:44.677872 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8708cae8-e3ea-4ca0-84b9-f68ef4a4e53d req-36f525ad-d901-4aec-9569-9eda118b651f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0885704 Feb 17 18:09:44.726553 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8708cae8-e3ea-4ca0-84b9-f68ef4a4e53d req-295a9b74-ff41-47b8-bc9e-6948c0884ab1 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418432 Feb 17 18:09:45.436719 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:45.510573 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:45.745280 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-545c8870-4442-4822-bb71-5998feef474f req-7544d3ee-8974-4913-b428-bd21b494b42b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:45.747431 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-545c8870-4442-4822-bb71-5998feef474f req-7544d3ee-8974-4913-b428-bd21b494b42b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1974902 Feb 17 18:09:45.784444 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f43cba79-eb37-4bde-b4f4-b50e3cbd70b7 req-fda16d70-f046-4c95-a907-bf6af7a85180 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:45.786091 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f43cba79-eb37-4bde-b4f4-b50e3cbd70b7 req-fda16d70-f046-4c95-a907-bf6af7a85180 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.1790578 Feb 17 18:09:45.859345 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-545c8870-4442-4822-bb71-5998feef474f req-9389a4d0-fe60-4855-a29b-a2a3b1770b28 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0972440 Feb 17 18:09:45.864533 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f43cba79-eb37-4bde-b4f4-b50e3cbd70b7 req-cc3b963a-5883-4ed8-9d0b-82f71fa98654 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0687420 Feb 17 18:09:46.086841 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7ae19ad-667f-47e1-8f9e-eba34affaa72 req-c70e81ef-ad08-40d2-9f8c-12a4bd038708 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:46.088487 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a7ae19ad-667f-47e1-8f9e-eba34affaa72 req-c70e81ef-ad08-40d2-9f8c-12a4bd038708 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0965481 Feb 17 18:09:46.139504 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a7ae19ad-667f-47e1-8f9e-eba34affaa72 req-01be40d7-c056-4a35-a3b6-5413f0fac38a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440614 Feb 17 18:09:47.106978 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b396aa-cda9-4bf5-9b2d-1d74dd053c07 req-006ef366-dc59-4a0f-b219-65838b0124a9 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:47.118244 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a6b396aa-cda9-4bf5-9b2d-1d74dd053c07 req-006ef366-dc59-4a0f-b219-65838b0124a9 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.1029313 Feb 17 18:09:47.192666 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a6b396aa-cda9-4bf5-9b2d-1d74dd053c07 req-070d5ee3-7057-41ed-959c-fc48d6b3cae2 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686734 Feb 17 18:09:47.434630 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc760fd-89f9-46dc-a050-b85f80cea7f8 req-b56b879e-d32d-458d-b26a-282dbcf09a0f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:47.436322 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3cc760fd-89f9-46dc-a050-b85f80cea7f8 req-b56b879e-d32d-458d-b26a-282dbcf09a0f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1719949 Feb 17 18:09:47.443758 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d8c404d-3973-44ab-836d-ede91cd9f0e4 req-a707d4d0-61b1-4bc1-a441-7824688f0547 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:47.451813 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5d8c404d-3973-44ab-836d-ede91cd9f0e4 req-a707d4d0-61b1-4bc1-a441-7824688f0547 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 945 time: 0.1244216 Feb 17 18:09:47.524945 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3cc760fd-89f9-46dc-a050-b85f80cea7f8 req-619d4c1c-0fc6-46f2-bdea-b583e2c554e4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0785937 Feb 17 18:09:47.535960 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5d8c404d-3973-44ab-836d-ede91cd9f0e4 req-8d736157-0bf0-4550-89b7-2c48396650f9 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686982 Feb 17 18:09:47.756158 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:47.877902 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-135c3137-8720-48b5-9268-67d7e0e4fe61 req-3f7fa934-6ede-4a86-9cb3-9c614c468363 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:47.880257 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-135c3137-8720-48b5-9268-67d7e0e4fe61 req-3f7fa934-6ede-4a86-9cb3-9c614c468363 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.1770248 Feb 17 18:09:47.889445 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2772e9b4-0723-4f4d-aaeb-fce78b257898 req-363be8bf-85c7-40f2-a661-f5c5aea5d024 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:47.891102 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2772e9b4-0723-4f4d-aaeb-fce78b257898 req-363be8bf-85c7-40f2-a661-f5c5aea5d024 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1899204 Feb 17 18:09:47.978115 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-135c3137-8720-48b5-9268-67d7e0e4fe61 req-d246bef6-31df-4560-b870-8e510b920a5d tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0859635 Feb 17 18:09:47.982906 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2772e9b4-0723-4f4d-aaeb-fce78b257898 req-214dab46-54e5-48d1-bdcb-ecf7907a537d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0744653 Feb 17 18:09:48.626928 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9f5ff80-189f-4948-9368-8890d42d7528 req-e58db84a-abae-476e-8c8e-c154d09fdae8 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:48.629679 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d9f5ff80-189f-4948-9368-8890d42d7528 req-e58db84a-abae-476e-8c8e-c154d09fdae8 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.1153328 Feb 17 18:09:48.687665 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d9f5ff80-189f-4948-9368-8890d42d7528 req-a052d57d-ade1-489b-9ccc-fbbca441eb2e tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501530 Feb 17 18:09:48.889473 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d79ea8a0-1f65-488e-ab7c-554d985c5aca req-54ec91c6-519f-4500-bf4b-e28a27b086b3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:48.891543 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d79ea8a0-1f65-488e-ab7c-554d985c5aca req-54ec91c6-519f-4500-bf4b-e28a27b086b3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1640162 Feb 17 18:09:48.955368 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d79ea8a0-1f65-488e-ab7c-554d985c5aca req-e499e593-6b85-4fea-ac4b-08354467b89d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568008 Feb 17 18:09:48.962372 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa58aba2-2307-4204-bc39-2fc6ad0b4633 req-67b15f6a-98a5-4c44-a72d-584ec17c2c64 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:48.963899 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-aa58aba2-2307-4204-bc39-2fc6ad0b4633 req-67b15f6a-98a5-4c44-a72d-584ec17c2c64 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 945 time: 0.1529393 Feb 17 18:09:49.017518 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-aa58aba2-2307-4204-bc39-2fc6ad0b4633 req-05810477-ae0d-449c-b48c-9548249df3bf tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460520 Feb 17 18:09:49.286084 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6834d1e-a205-4162-8c88-92c49661bc2b req-4048c2eb-9b7d-45fd-96b3-d3938cf5e004 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:49.289498 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c6834d1e-a205-4162-8c88-92c49661bc2b req-4048c2eb-9b7d-45fd-96b3-d3938cf5e004 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 945 time: 0.1255307 Feb 17 18:09:49.299914 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fbb091a-1832-483f-a8e9-4df34576fcfe req-44daa556-3e54-4719-a918-5a52ff4a2499 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:49.302546 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3fbb091a-1832-483f-a8e9-4df34576fcfe req-44daa556-3e54-4719-a918-5a52ff4a2499 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1795683 Feb 17 18:09:49.416692 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3fbb091a-1832-483f-a8e9-4df34576fcfe req-dd6482c5-4ded-44bd-bc00-1a2b24afc2c3 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0743167 Feb 17 18:09:49.423481 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-c6834d1e-a205-4162-8c88-92c49661bc2b req-00ec6f52-2af6-4775-a665-b10ed59ff729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Deleting port 75d0676f-fef4-4868-aa7b-f5dda8df8073 {{(pid=84111) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:09:49.424229 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-c6834d1e-a205-4162-8c88-92c49661bc2b req-00ec6f52-2af6-4775-a665-b10ed59ff729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:49.770382 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-c6834d1e-a205-4162-8c88-92c49661bc2b req-00ec6f52-2af6-4775-a665-b10ed59ff729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] For port 75d0676f-fef4-4868-aa7b-f5dda8df8073, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=75d0676f-fef4-4868-aa7b-f5dda8df8073,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84111) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:09:49.771023 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-c6834d1e-a205-4162-8c88-92c49661bc2b req-00ec6f52-2af6-4775-a665-b10ed59ff729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:49.914741 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-c6834d1e-a205-4162-8c88-92c49661bc2b req-00ec6f52-2af6-4775-a665-b10ed59ff729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Calling delete_port for 75d0676f-fef4-4868-aa7b-f5dda8df8073 owned by compute:nova {{(pid=84111) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:09:50.487486 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9fa875e-edf7-415a-9d8a-b314215f5bd9 req-f65f7904-bb48-45d0-be05-650707fad495 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:50.489727 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c9fa875e-edf7-415a-9d8a-b314215f5bd9 req-f65f7904-bb48-45d0-be05-650707fad495 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.2156024 Feb 17 18:09:50.495657 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c89524-15f3-4a3b-8974-3aebf5d7c1c3 req-2879be29-06bf-4819-a165-6c8d5e0be377 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:50.497228 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d2c89524-15f3-4a3b-8974-3aebf5d7c1c3 req-2879be29-06bf-4819-a165-6c8d5e0be377 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 945 time: 0.2218041 Feb 17 18:09:50.571169 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 75d0676f-fef4-4868-aa7b-f5dda8df8073 no longer exists at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:09:50.622233 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c9fa875e-edf7-415a-9d8a-b314215f5bd9 req-84d1abb7-8908-4e95-9e60-e2ffc8a8b32a tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1208761 Feb 17 18:09:50.635602 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-c6834d1e-a205-4162-8c88-92c49661bc2b req-00ec6f52-2af6-4775-a665-b10ed59ff729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:50.636162 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] No Port match for: 75d0676f-fef4-4868-aa7b-f5dda8df8073 {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:09:50.636743 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 75d0676f-fef4-4868-aa7b-f5dda8df8073 not bound to the agent host hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:09:50.639908 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d2c89524-15f3-4a3b-8974-3aebf5d7c1c3 req-75862c73-bff5-4f23-b3d8-f2d300d41a0e tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1328051 Feb 17 18:09:50.668641 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:50.813206 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00ec6f52-2af6-4775-a665-b10ed59ff729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Pushing event deleted for resources: {'Port': ['ID=75d0676f-fef4-4868-aa7b-f5dda8df8073,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:50.824554 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-00ec6f52-2af6-4775-a665-b10ed59ff729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:50.919447 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f95527a7-d7e6-4ec4-8a47-ad45e3fff034 req-b1983de4-a328-4b1d-ba7d-b383dcf3385a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:50.921118 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f95527a7-d7e6-4ec4-8a47-ad45e3fff034 req-b1983de4-a328-4b1d-ba7d-b383dcf3385a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1618004 Feb 17 18:09:50.979158 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-c6834d1e-a205-4162-8c88-92c49661bc2b req-00ec6f52-2af6-4775-a665-b10ed59ff729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] No DVR routers for this DVR port 75d0676f-fef4-4868-aa7b-f5dda8df8073 on host hv-cinder-76019 {{(pid=84111) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Feb 17 18:09:50.986366 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-c6834d1e-a205-4162-8c88-92c49661bc2b req-00ec6f52-2af6-4775-a665-b10ed59ff729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:50.989145 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ce54bae9-f6d3-439f-b544-92e481dfd9dc', 'name': 'network-vif-deleted', 'tag': '75d0676f-fef4-4868-aa7b-f5dda8df8073'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:09:51.023992 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f95527a7-d7e6-4ec4-8a47-ad45e3fff034 req-2fff93ad-7426-4255-9222-7e82b127f531 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0699849 Feb 17 18:09:51.048639 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c6834d1e-a205-4162-8c88-92c49661bc2b req-00ec6f52-2af6-4775-a665-b10ed59ff729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "DELETE /v2.0/ports/75d0676f-fef4-4868-aa7b-f5dda8df8073 HTTP/1.1" status: 204 len: 173 time: 1.7449343 Feb 17 18:09:51.088940 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ce54bae9-f6d3-439f-b544-92e481dfd9dc', 'name': 'network-vif-deleted', 'tag': '75d0676f-fef4-4868-aa7b-f5dda8df8073', 'status': 'completed', 'code': 200} Feb 17 18:09:51.348621 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d625bc-e903-4443-ab46-b54aa23fdf59 req-d308a9ea-b884-41ae-a453-a92ab636c477 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:51.350239 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b8d625bc-e903-4443-ab46-b54aa23fdf59 req-d308a9ea-b884-41ae-a453-a92ab636c477 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 1162 time: 0.0971618 Feb 17 18:09:51.499068 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d625bc-e903-4443-ab46-b54aa23fdf59 req-dabc3240-4b16-4a47-9679-68643793757c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:51.500757 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b8d625bc-e903-4443-ab46-b54aa23fdf59 req-dabc3240-4b16-4a47-9679-68643793757c service neutron] 10.222.0.70 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 907 time: 0.1434724 Feb 17 18:09:51.620705 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b8d625bc-e903-4443-ab46-b54aa23fdf59 req-612ba758-613a-4780-8514-8750d86a45b5 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 HTTP/1.1" status: 200 len: 1000 time: 0.1052141 Feb 17 18:09:51.709107 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d625bc-e903-4443-ab46-b54aa23fdf59 req-3d07f04f-f24f-4457-878f-aa332838b558 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:51.710749 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b8d625bc-e903-4443-ab46-b54aa23fdf59 req-3d07f04f-f24f-4457-878f-aa332838b558 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2f43211a-7773-487d-8b86-a136c7f7c156 HTTP/1.1" status: 200 len: 852 time: 0.0805292 Feb 17 18:09:51.909597 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-6ae6056e-3210-4bc0-98fc-303ba3e21c55 req-74ada772-9706-4044-a1b5-e9200542bfbc tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Synchronizing usage tracker for tenant:c2e8792284c348238cf9afdcae0c221e on resource:port {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:09:51.954478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4000eaf1-81a3-4280-98cb-3c9c356a8509 req-cff2438c-ce86-40eb-803e-2ac4722fa93e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:51.956113 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4000eaf1-81a3-4280-98cb-3c9c356a8509 req-cff2438c-ce86-40eb-803e-2ac4722fa93e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1895609 Feb 17 18:09:51.961506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d625bc-e903-4443-ab46-b54aa23fdf59 req-67ee1d5e-a961-49bd-849f-ba784cd00729 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:51.963106 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b8d625bc-e903-4443-ab46-b54aa23fdf59 req-67ee1d5e-a961-49bd-849f-ba784cd00729 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2442341 Feb 17 18:09:52.058498 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-6ae6056e-3210-4bc0-98fc-303ba3e21c55 req-74ada772-9706-4044-a1b5-e9200542bfbc tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Unset dirty status for tenant:c2e8792284c348238cf9afdcae0c221e on resource:port {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:09:52.059800 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6ae6056e-3210-4bc0-98fc-303ba3e21c55 req-74ada772-9706-4044-a1b5-e9200542bfbc tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=ce54bae9-f6d3-439f-b544-92e481dfd9dc HTTP/1.1" status: 200 len: 210 time: 0.2235651 Feb 17 18:09:52.104574 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4000eaf1-81a3-4280-98cb-3c9c356a8509 req-6fd2e8af-1c6a-49d4-8a10-79fff9f018a2 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1403930 Feb 17 18:09:52.148813 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b8d625bc-e903-4443-ab46-b54aa23fdf59 req-32493e8c-c440-413c-bed0-fba9c0a1f340 service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1691163 Feb 17 18:09:52.152916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-838d23c1-b370-4f1e-a7e6-e6f7b0f6b2f9 req-9c5c2819-cbca-43d4-846c-e3e11e07c976 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:52.154510 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-838d23c1-b370-4f1e-a7e6-e6f7b0f6b2f9 req-9c5c2819-cbca-43d4-846c-e3e11e07c976 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 1162 time: 0.0949414 Feb 17 18:09:52.210495 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-838d23c1-b370-4f1e-a7e6-e6f7b0f6b2f9 req-f07095e9-a370-463e-917e-99b8e34dbf8c service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0371232 Feb 17 18:09:52.388399 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-593181ea-47bb-432d-82c7-e8cce05b9162 req-f5c627d8-f09b-4f2d-a0df-dc827862b592 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:52.390005 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-593181ea-47bb-432d-82c7-e8cce05b9162 req-f5c627d8-f09b-4f2d-a0df-dc827862b592 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1932507 Feb 17 18:09:52.391891 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b8d625bc-e903-4443-ab46-b54aa23fdf59 req-b4122d73-fe82-4e2f-8a09-6203b12290ba service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2195549 Feb 17 18:09:52.440279 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-593181ea-47bb-432d-82c7-e8cce05b9162 req-f7564c92-927e-4baf-81f2-02efbed4f06b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420887 Feb 17 18:09:53.118959 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:09:53.310893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9cf6c0b-0f27-4c20-932e-f75589bc2597 req-0f3b69ce-3e55-4f3e-81a4-2691d8e88ecf tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:53.312549 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e9cf6c0b-0f27-4c20-932e-f75589bc2597 req-0f3b69ce-3e55-4f3e-81a4-2691d8e88ecf tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0874636 Feb 17 18:09:53.369182 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e9cf6c0b-0f27-4c20-932e-f75589bc2597 req-60e51249-ffec-4efb-9dbc-8cd780528d1a tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449352 Feb 17 18:09:53.662013 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e56c7c4-df5e-4764-af5e-cd2fbbc3c31f req-390c94d9-de1c-4023-87ec-4d7bcac3c959 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:53.663650 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2e56c7c4-df5e-4764-af5e-cd2fbbc3c31f req-390c94d9-de1c-4023-87ec-4d7bcac3c959 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1015241 Feb 17 18:09:53.711642 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2e56c7c4-df5e-4764-af5e-cd2fbbc3c31f req-5f4c901a-e9e1-43f3-8383-d3f7c42c8162 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416100 Feb 17 18:09:54.572022 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07eeb1d2-50f0-40f5-80f6-b75358c1ddaa req-c637fec8-778b-4095-990a-d5af274500f8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:54.573879 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-07eeb1d2-50f0-40f5-80f6-b75358c1ddaa req-c637fec8-778b-4095-990a-d5af274500f8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0907886 Feb 17 18:09:54.643072 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-07eeb1d2-50f0-40f5-80f6-b75358c1ddaa req-5f698563-69c3-464a-ac9a-c3afdec83dc4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450530 Feb 17 18:09:54.689193 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:09:54.764462 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port c3de3799-da31-433f-9203-bfbce68f8d59 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:09:54.764886 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:54.965935 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d229583-30ee-49ce-b844-af8cbbf549b3 req-78d024e0-2da7-4832-933b-b5ca6583969f tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:54.969675 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4d229583-30ee-49ce-b844-af8cbbf549b3 req-78d024e0-2da7-4832-933b-b5ca6583969f tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 945 time: 0.1193082 Feb 17 18:09:55.067443 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4d229583-30ee-49ce-b844-af8cbbf549b3 req-37800d21-0ed3-4281-b307-0e06aeb6ddb2 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0926707 Feb 17 18:09:55.110814 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e17ee9-f244-4091-8349-e8e7c2ec57eb req-ae3389d3-8234-4414-a1d3-448af3b343ac tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:55.112446 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e6e17ee9-f244-4091-8349-e8e7c2ec57eb req-ae3389d3-8234-4414-a1d3-448af3b343ac tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1020486 Feb 17 18:09:55.161295 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e6e17ee9-f244-4091-8349-e8e7c2ec57eb req-c5335414-b2ce-45dd-8fe7-3791ff7a91be tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423279 Feb 17 18:09:55.519951 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f9699f-a149-4939-b611-d46fd48cada3 req-7347cbf0-0f1a-4e1a-b67a-598d0aa56f1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:55.521572 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-45f9699f-a149-4939-b611-d46fd48cada3 req-7347cbf0-0f1a-4e1a-b67a-598d0aa56f1e service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bda7a35e855840d7bc75e16e402f3690&device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 1162 time: 0.1523468 Feb 17 18:09:55.528743 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7fd501a-5bc1-47f0-9e2c-da877abc2547 req-5ff84f04-e7ec-49dc-8666-651b8e94a028 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:55.530231 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f7fd501a-5bc1-47f0-9e2c-da877abc2547 req-5ff84f04-e7ec-49dc-8666-651b8e94a028 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1200030 Feb 17 18:09:55.669723 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f7fd501a-5bc1-47f0-9e2c-da877abc2547 req-f4c91f75-b5eb-44b6-b807-2b2ca9dc5f41 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1149242 Feb 17 18:09:55.708304 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f9699f-a149-4939-b611-d46fd48cada3 req-21f32d84-dfff-4d31-921a-fc9ec5ba4d62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:55.709886 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-45f9699f-a149-4939-b611-d46fd48cada3 req-21f32d84-dfff-4d31-921a-fc9ec5ba4d62 service neutron] 10.222.0.70 "GET /v2.0/networks?id=4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 200 len: 913 time: 0.1787524 Feb 17 18:09:55.787988 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-45f9699f-a149-4939-b611-d46fd48cada3 req-ae350e32-6d37-4a63-a329-d15cd117ebe2 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c3de3799-da31-433f-9203-bfbce68f8d59 HTTP/1.1" status: 200 len: 217 time: 0.0683022 Feb 17 18:09:55.856013 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f9699f-a149-4939-b611-d46fd48cada3 req-d9c23983-942f-4798-aa07-1c33a8a30f2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:55.857525 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-45f9699f-a149-4939-b611-d46fd48cada3 req-d9c23983-942f-4798-aa07-1c33a8a30f2f service neutron] 10.222.0.70 "GET /v2.0/subnets?id=c04f01da-1295-4b8a-95ae-46589cb07040 HTTP/1.1" status: 200 len: 859 time: 0.0627141 Feb 17 18:09:55.914533 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-45f9699f-a149-4939-b611-d46fd48cada3 req-12f60549-5f9e-48db-85e2-3142ce47014c service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4aaf4a03-4480-421f-bff4-f9814e969001&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0475152 Feb 17 18:09:56.372342 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-45f9699f-a149-4939-b611-d46fd48cada3 req-3eaaf5b0-75ad-40ea-93d7-ae1c3cd5a76b service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4489167 Feb 17 18:09:56.515439 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ca8126c-78de-4c8d-89d4-128008ff8099 req-f11ecb0c-0ac8-4b67-a2ca-b45a7f67880a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:56.517079 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7ca8126c-78de-4c8d-89d4-128008ff8099 req-f11ecb0c-0ac8-4b67-a2ca-b45a7f67880a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 945 time: 0.2734427 Feb 17 18:09:56.526031 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-599c5824-6d5c-414e-b569-85fe0bd95f34 req-4b13cad4-d2bf-4458-859f-919b02035f31 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:56.527472 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-599c5824-6d5c-414e-b569-85fe0bd95f34 req-4b13cad4-d2bf-4458-859f-919b02035f31 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.2460046 Feb 17 18:09:56.601403 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-45f9699f-a149-4939-b611-d46fd48cada3 req-4657bef3-bb04-453e-a07b-74a351375da5 service neutron] 10.222.0.70 "GET /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2154672 Feb 17 18:09:56.635109 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7ca8126c-78de-4c8d-89d4-128008ff8099 req-4e82db31-f207-4ce7-8f01-4d4e3e99cce8 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042747 Feb 17 18:09:56.639653 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-599c5824-6d5c-414e-b569-85fe0bd95f34 req-f5be4b94-9856-480b-8510-56bad0694b76 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0975151 Feb 17 18:09:56.729575 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:09:56.820561 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:09:56.821220 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:56.904474 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37b12d84-a98c-403b-9748-7a8f2fdc8b25 req-e5359df3-9e6c-4447-8e2c-2c5a5e2f660f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:56.906096 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-37b12d84-a98c-403b-9748-7a8f2fdc8b25 req-e5359df3-9e6c-4447-8e2c-2c5a5e2f660f tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0935144 Feb 17 18:09:56.957519 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-37b12d84-a98c-403b-9748-7a8f2fdc8b25 req-361df46b-f949-4ef7-9af7-b7abb4179337 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440671 Feb 17 18:09:56.963460 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 no longer exists at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:09:57.086104 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:57.115323 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:09:57.126141 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89,segment=NetworkSegment(a3b9a246-e8d6-47cc-bbb0-e0531b20a903),segment_id=a3b9a246-e8d6-47cc-bbb0-e0531b20a903)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:09:57.156596 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:57.159143 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:57.172147 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef19939-86e6-436c-b7c6-3cd106c363fa req-07c090f0-a75f-49f6-b8f1-ea452dafdf50 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:57.173228 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fef19939-86e6-436c-b7c6-3cd106c363fa req-07c090f0-a75f-49f6-b8f1-ea452dafdf50 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 945 time: 0.0973933 Feb 17 18:09:57.196770 dv-cinder-760194-3-iscsi neutron-server[84000]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89', 'code': 422} returned with failed status Feb 17 18:09:57.233277 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89,revision_number=5']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:57.236864 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:57.267381 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-fef19939-86e6-436c-b7c6-3cd106c363fa req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Deleting port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 {{(pid=84111) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:09:57.267759 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-fef19939-86e6-436c-b7c6-3cd106c363fa req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:57.531817 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-fef19939-86e6-436c-b7c6-3cd106c363fa req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] For port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=a1b6e84d-6b15-4d65-9ce7-f45f4a58e775,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84111) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:09:57.532236 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-fef19939-86e6-436c-b7c6-3cd106c363fa req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:57.668742 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-fef19939-86e6-436c-b7c6-3cd106c363fa req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Calling delete_port for a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 owned by compute:nova {{(pid=84111) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:09:57.899692 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30c4a142-37ba-4355-b6d8-5b9249a2d0d1 req-87b8f277-c9d9-48a5-ae67-b9e72e5edb0a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:57.901369 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-30c4a142-37ba-4355-b6d8-5b9249a2d0d1 req-87b8f277-c9d9-48a5-ae67-b9e72e5edb0a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 945 time: 0.1507280 Feb 17 18:09:57.929460 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-fef19939-86e6-436c-b7c6-3cd106c363fa req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:57.953856 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:09:58.111699 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Pushing event deleted for resources: {'Port': ['ID=a1b6e84d-6b15-4d65-9ce7-f45f4a58e775,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:09:58.129721 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.130128 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.130527 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.130917 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.131308 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.131695 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.132126 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.132507 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.132893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.133272 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.133649 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.134024 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.134439 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.134815 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.135188 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.135564 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.135981 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.136362 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.136736 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.137110 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.137486 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.137861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.138238 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.138613 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:09:58.151710 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:09:58.160616 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 58274) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:09:58.162568 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-30c4a142-37ba-4355-b6d8-5b9249a2d0d1 req-89776802-3bff-4664-832b-e25d20a215de tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2537079 Feb 17 18:09:58.232438 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b7951d-7c28-4e3d-b74a-e6ef12a0045a req-0b8713d8-a668-4962-a3ea-f7a322e08c05 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:58.234038 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-65b7951d-7c28-4e3d-b74a-e6ef12a0045a req-0b8713d8-a668-4962-a3ea-f7a322e08c05 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.2854128 Feb 17 18:09:58.311671 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-8140bedb-8458-49c9-b77b-7644b6bcacbd service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1432004 Feb 17 18:09:58.317626 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-fef19939-86e6-436c-b7c6-3cd106c363fa req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] No DVR routers for this DVR port a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 on host hv-cinder-76019 {{(pid=84111) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Feb 17 18:09:58.361191 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-fef19939-86e6-436c-b7c6-3cd106c363fa req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:58.364566 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4da5abf8-f53e-4899-800d-f4920eeb2fa4', 'name': 'network-vif-deleted', 'tag': 'a1b6e84d-6b15-4d65-9ce7-f45f4a58e775'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:09:58.380777 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-65b7951d-7c28-4e3d-b74a-e6ef12a0045a req-6a923aae-61f7-4ee7-9021-4d119b75a651 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1130986 Feb 17 18:09:58.427120 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fef19939-86e6-436c-b7c6-3cd106c363fa req-dd157554-92b8-47fe-95ed-3e4d94f6a815 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "DELETE /v2.0/ports/a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 HTTP/1.1" status: 204 len: 173 time: 1.2415528 Feb 17 18:09:58.438887 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8dc9e4-e322-42aa-bde3-cf701d2533ec req-daf173fa-8c7a-4cb9-8729-42bee2d31bc5 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:58.440440 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7b8dc9e4-e322-42aa-bde3-cf701d2533ec req-daf173fa-8c7a-4cb9-8729-42bee2d31bc5 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1278102 Feb 17 18:09:58.447596 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4da5abf8-f53e-4899-800d-f4920eeb2fa4', 'name': 'network-vif-deleted', 'tag': 'a1b6e84d-6b15-4d65-9ce7-f45f4a58e775', 'status': 'completed', 'code': 200} Feb 17 18:09:58.508534 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7b8dc9e4-e322-42aa-bde3-cf701d2533ec req-1db1e8be-6047-4b93-9916-58d984311860 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556366 Feb 17 18:09:59.231290 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:09:59.359387 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port c3de3799-da31-433f-9203-bfbce68f8d59 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:09:59.359803 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:09:59.384373 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-a80e874a-5618-421b-9b14-24e06e2879e6 req-05b8020a-0ca0-4e0c-bca7-2010ca79cb53 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Synchronizing usage tracker for tenant:c2e8792284c348238cf9afdcae0c221e on resource:port {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:09:59.458821 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-a80e874a-5618-421b-9b14-24e06e2879e6 req-05b8020a-0ca0-4e0c-bca7-2010ca79cb53 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Unset dirty status for tenant:c2e8792284c348238cf9afdcae0c221e on resource:port {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:09:59.463522 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a80e874a-5618-421b-9b14-24e06e2879e6 req-05b8020a-0ca0-4e0c-bca7-2010ca79cb53 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=4da5abf8-f53e-4899-800d-f4920eeb2fa4 HTTP/1.1" status: 200 len: 210 time: 0.1355412 Feb 17 18:09:59.531578 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 no longer exists at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:09:59.563126 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] No Port match for: a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:09:59.563555 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device a1b6e84d-6b15-4d65-9ce7-f45f4a58e775 not bound to the agent host hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:09:59.627556 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a222ce51-6749-4e0a-ae54-bd60d4caaca5 req-6e971dcb-d5b8-4e20-aa2a-8944aac2a81a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:59.629301 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a222ce51-6749-4e0a-ae54-bd60d4caaca5 req-6e971dcb-d5b8-4e20-aa2a-8944aac2a81a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.1073577 Feb 17 18:09:59.740456 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a222ce51-6749-4e0a-ae54-bd60d4caaca5 req-b5e313b7-875d-45a0-b762-9ecb3135d5af tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0659623 Feb 17 18:09:59.760202 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b40a9abc-1bc1-4620-b9bc-688b6eaac373 req-45a22eec-e0ac-4cde-9e75-53daf352776b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:59.761836 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b40a9abc-1bc1-4620-b9bc-688b6eaac373 req-45a22eec-e0ac-4cde-9e75-53daf352776b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1315629 Feb 17 18:09:59.811021 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b40a9abc-1bc1-4620-b9bc-688b6eaac373 req-756fe1a4-eabd-485a-be36-8c6d6a827c8e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423427 Feb 17 18:09:59.931478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d62fdcf1-e186-4bcd-a856-d1ac152696e5 req-6aa836f0-13c5-4329-bf38-01c4ee39e6a0 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:09:59.933123 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d62fdcf1-e186-4bcd-a856-d1ac152696e5 req-6aa836f0-13c5-4329-bf38-01c4ee39e6a0 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.0885594 Feb 17 18:09:59.981642 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d62fdcf1-e186-4bcd-a856-d1ac152696e5 req-2064747f-21fd-4af1-a89d-1c72c20db30c tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422869 Feb 17 18:10:00.233538 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-82847b10-075e-4579-99d4-8cd8400bef73 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.2101688 Feb 17 18:10:00.244023 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Request body: {'floatingip': {'floating_network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:10:00.249632 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:10:00.254216 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Usage tracker for resource:floatingip and tenant:5729c656e2c64606a663d6434a5c3973 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:10:00.257339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:10:00.263233 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:10:00.304880 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for floatingip, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:00.515768 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:00.537478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-11f80d61-068f-4e79-8ec0-05478380733a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:00.539086 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-11f80d61-068f-4e79-8ec0-05478380733a service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0&tenant_id=bd48a3996f1246f1ab69d3866874af0b HTTP/1.1" status: 200 len: 1160 time: 0.1238999 Feb 17 18:10:00.774170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-8e8e4894-3f77-4e87-bfb1-fed7a0cb866f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:00.775813 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-8e8e4894-3f77-4e87-bfb1-fed7a0cb866f service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 1160 time: 0.1703706 Feb 17 18:10:01.256521 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Allocated IP 172.27.1.226 (68fd415f-8606-43f8-b4d1-98e6a9c9af94/1c895d8f-55ff-4bdb-a323-742172b9934e/146ee682-cfe9-4336-9404-1f419a819989) {{(pid=84111) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:10:01.294258 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-601059a1-78c8-46e3-bf5e-ef9f650a714a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:01.295862 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-601059a1-78c8-46e3-bf5e-ef9f650a714a service neutron] 10.222.0.70 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 907 time: 0.5109098 Feb 17 18:10:01.449721 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39dcb3a4-ab19-4545-907d-f5df0e11b55d req-a6c19e2a-1f50-4a59-91cd-771dd42505b0 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:01.451354 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39dcb3a4-ab19-4545-907d-f5df0e11b55d req-a6c19e2a-1f50-4a59-91cd-771dd42505b0 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.3626928 Feb 17 18:10:01.567282 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-239faade-8655-48b9-94a3-a4cb6303db8c service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 HTTP/1.1" status: 200 len: 998 time: 0.2543576 Feb 17 18:10:01.576875 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-39dcb3a4-ab19-4545-907d-f5df0e11b55d req-96f20435-4657-44f0-8859-adebf750877a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1053162 Feb 17 18:10:01.661818 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for port, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:01.686551 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-a58f824c-826c-4266-a859-a96bba5c8f84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:01.688100 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-a58f824c-826c-4266-a859-a96bba5c8f84 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2f43211a-7773-487d-8b86-a136c7f7c156 HTTP/1.1" status: 200 len: 852 time: 0.1079571 Feb 17 18:10:01.840330 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:01.865228 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:01.984777 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-014d93fd-6048-4d0a-94aa-3f3a8f8360b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:01.986361 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-014d93fd-6048-4d0a-94aa-3f3a8f8360b3 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2898533 Feb 17 18:10:01.996335 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9d9530d-575c-4899-988a-cbfa5e8ac822 req-0f3dc5c7-6b2f-4fee-ba7f-cf57c1d6d2d2 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:01.997816 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d9d9530d-575c-4899-988a-cbfa5e8ac822 req-0f3dc5c7-6b2f-4fee-ba7f-cf57c1d6d2d2 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 946 time: 0.2620287 Feb 17 18:10:02.115877 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Pushing event updated for resources: {'Port': ['ID=146ee682-cfe9-4336-9404-1f419a819989,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:02.128896 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:02.200501 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d9d9530d-575c-4899-988a-cbfa5e8ac822 req-37b1bdd3-bb9d-4283-acfa-f62ebff26d12 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1701751 Feb 17 18:10:02.235412 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-d201b280-3f47-4bb4-b258-b9b30397a687 service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2330139 Feb 17 18:10:02.237171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 is already hosted by enough agents. {{(pid=84111) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:10:02.238817 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Resources bound (agent type, host, resource id): {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:10:02.241033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Received port after_create {{(pid=84111) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:10:02.443224 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5e3ed1ce-581c-41aa-adf6-44bda6b3d6af req-44e64ad9-c7a0-465e-aa66-fa999dcfede2 service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1722596 Feb 17 18:10:02.449218 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for floatingip, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:02.537268 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-ed916e21-e697-44d2-b62e-c6e9b6ed18dc tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:02.538030 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-ed916e21-e697-44d2-b62e-c6e9b6ed18dc tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Synchronizing usage tracker for tenant:c2e8792284c348238cf9afdcae0c221e on resource:port {{(pid=84112) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:10:02.539967 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:02.551058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-ed916e21-e697-44d2-b62e-c6e9b6ed18dc tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Unset dirty status for tenant:c2e8792284c348238cf9afdcae0c221e on resource:port {{(pid=84112) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:10:02.552293 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-ed916e21-e697-44d2-b62e-c6e9b6ed18dc tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 946 time: 0.1029096 Feb 17 18:10:02.643257 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Deleting port 4e092f78-701d-48e1-8837-664198422e8e {{(pid=84112) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:10:02.643571 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:02.664327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device 4e092f78-701d-48e1-8837-664198422e8e no longer exists at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:10:02.857810 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:02.888421 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c13a0fb6-558a-4c45-afa0-ed7e0da69c21', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4e092f78-701d-48e1-8837-664198422e8e'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:10:02.899241 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port 4e092f78-701d-48e1-8837-664198422e8e, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=4e092f78-701d-48e1-8837-664198422e8e,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:10:02.944114 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:02.946786 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:02.955954 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6395ba54-e896-4bbb-8c67-8f637996b257 req-30feba67-b1e3-4fac-bfaa-7744b3e9f465 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:02.958202 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6395ba54-e896-4bbb-8c67-8f637996b257 req-30feba67-b1e3-4fac-bfaa-7744b3e9f465 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.2195680 Feb 17 18:10:02.980640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for port, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:03.019810 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] For port 4e092f78-701d-48e1-8837-664198422e8e, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=4e092f78-701d-48e1-8837-664198422e8e,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84112) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:10:03.020463 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:03.025931 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4125045'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:03.029621 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6395ba54-e896-4bbb-8c67-8f637996b257 req-0ff859d6-e4c8-4d2d-99cd-69688a1b62e2 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466516 Feb 17 18:10:03.060125 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=4e092f78-701d-48e1-8837-664198422e8e,revision_number=5']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:03.065270 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.065668 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.066098 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.066484 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.066861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.067236 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.067607 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.068744 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.069124 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.069501 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.069877 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.070250 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.070661 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.071413 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.071634 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.072044 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.072561 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.072933 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.073376 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.083193 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.083193 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.083193 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.083193 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.083193 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:03.089463 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:03.115409 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c13a0fb6-558a-4c45-afa0-ed7e0da69c21', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4e092f78-701d-48e1-8837-664198422e8e', 'code': 200} Feb 17 18:10:03.167407 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d99fed29-e651-4cd3-a8b2-410fb2716665 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:03.203688 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Calling delete_port for 4e092f78-701d-48e1-8837-664198422e8e owned by compute:nova {{(pid=84112) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:10:03.276188 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Pushing event updated for resources: {'Port': ['ID=146ee682-cfe9-4336-9404-1f419a819989,revision_number=2']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:03.281742 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:03.360549 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036854376515'] for floatingip, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:03.386329 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.db.api [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=84112) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Feb 17 18:10:03.386694 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_db.api [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Feb 17 18:10:03.489585 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beb9a413-4f14-41e6-883f-cb77d126b604 req-2082a465-d141-490a-8139-44f6eebe3924 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:03.491256 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-beb9a413-4f14-41e6-883f-cb77d126b604 req-2082a465-d141-490a-8139-44f6eebe3924 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 944 time: 0.1008799 Feb 17 18:10:03.493184 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for floatingip, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:03.494354 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 3.2545509 Feb 17 18:10:03.620450 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-3adf8743-88bb-4728-acf1-0c2048aad3ce tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Synchronizing usage tracker for tenant:5729c656e2c64606a663d6434a5c3973 on resource:floatingip {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:10:03.637215 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-beb9a413-4f14-41e6-883f-cb77d126b604 req-911fc801-80ee-4f38-a461-d3b891087e98 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1393595 Feb 17 18:10:03.686980 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-3adf8743-88bb-4728-acf1-0c2048aad3ce tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Unset dirty status for tenant:5729c656e2c64606a663d6434a5c3973 on resource:floatingip {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:10:03.688484 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-3adf8743-88bb-4728-acf1-0c2048aad3ce tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.27.1.226 HTTP/1.1" status: 200 len: 696 time: 0.1758835 Feb 17 18:10:03.887851 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Deleting port 4e092f78-701d-48e1-8837-664198422e8e {{(pid=84112) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:10:03.888289 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:04.185176 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-d04c8a41-65c5-43cc-a435-86dea2e215a7 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:04.187163 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-d04c8a41-65c5-43cc-a435-86dea2e215a7 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/networks/68fd415f-8606-43f8-b4d1-98e6a9c9af94 HTTP/1.1" status: 200 len: 784 time: 0.4913423 Feb 17 18:10:04.204994 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-04a7ff0f-2b15-4b1b-8477-879fa6ead3f2 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=84111) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 17 18:10:04.206063 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-774cc63e-c668-4e5a-8562-672edd92e0e3 req-04a7ff0f-2b15-4b1b-8477-879fa6ead3f2 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13455 time: 0.0076981 Feb 17 18:10:04.273714 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] For port 4e092f78-701d-48e1-8837-664198422e8e, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=4e092f78-701d-48e1-8837-664198422e8e,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84112) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:10:04.274236 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:04.379540 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3619a051-cfa7-40b8-8830-59aa00211c0c req-c0d735c2-e1ef-41ba-a724-b6feb14a5ada tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:04.382142 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3619a051-cfa7-40b8-8830-59aa00211c0c req-c0d735c2-e1ef-41ba-a724-b6feb14a5ada tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.1750944 Feb 17 18:10:04.475977 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Calling delete_port for 4e092f78-701d-48e1-8837-664198422e8e owned by compute:nova {{(pid=84112) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:10:04.511842 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3619a051-cfa7-40b8-8830-59aa00211c0c req-afbc34cd-b51b-4d0e-9709-0c2b81e269a3 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1226914 Feb 17 18:10:04.539358 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-7134053f-36c0-4d1b-bb61-50f9b7f1dc62 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:04.540999 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-7134053f-36c0-4d1b-bb61-50f9b7f1dc62 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.1180594 Feb 17 18:10:04.683183 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-45564a59-37de-49af-97fd-103fa2ce9286 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.27.1.226 HTTP/1.1" status: 200 len: 696 time: 0.1179795 Feb 17 18:10:04.694628 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-8350b89f-46e3-42b9-a31f-490f34bd866f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Request body: {'floatingip': {'port_id': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0', 'fixed_ip_address': '172.20.0.7'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:10:04.814345 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-8350b89f-46e3-42b9-a31f-490f34bd866f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for floatingip, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:04.829454 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:04.856389 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-00bdd7d8-63af-4dc2-8628-880ad128e746 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:04.977507 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Pushing event deleted for resources: {'Port': ['ID=4e092f78-701d-48e1-8837-664198422e8e,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:05.042339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.042897 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.043143 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.043586 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.043970 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.044374 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.044986 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.045419 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.045816 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.046207 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.046597 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.046989 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.047421 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.047813 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.048244 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.049132 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.049532 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.049929 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.050851 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.051245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.051674 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.052111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.052441 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.052824 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:05.056738 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:05.178294 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] No DVR routers for this DVR port 4e092f78-701d-48e1-8837-664198422e8e on host hv-cinder-76019 {{(pid=84112) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Feb 17 18:10:05.182294 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:05.183704 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c13a0fb6-558a-4c45-afa0-ed7e0da69c21', 'name': 'network-vif-deleted', 'tag': '4e092f78-701d-48e1-8837-664198422e8e'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:10:05.223235 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-be3fac6e-3b71-4937-a4b2-227a314ee532 req-50b623d0-06eb-4385-a5cf-f29176b3d912 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 210 time: 0.0689163 Feb 17 18:10:05.236836 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3b21a207-e95b-4429-95ab-87e80dc20169 req-9fc9b19e-9254-42e2-9dd4-93503873a69a tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "DELETE /v2.0/ports/4e092f78-701d-48e1-8837-664198422e8e HTTP/1.1" status: 204 len: 173 time: 2.6787519 Feb 17 18:10:05.592457 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5ab85a5-72fc-4454-8d9e-6db8f1a3bcb1 req-875ed5c7-40d1-41b8-b5d4-99e00758d2e1 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:05.600552 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c5ab85a5-72fc-4454-8d9e-6db8f1a3bcb1 req-875ed5c7-40d1-41b8-b5d4-99e00758d2e1 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.2213726 Feb 17 18:10:05.682486 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c5ab85a5-72fc-4454-8d9e-6db8f1a3bcb1 req-6b92712f-c77f-40a5-b234-9d547da69c01 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809028 Feb 17 18:10:05.744136 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c13a0fb6-558a-4c45-afa0-ed7e0da69c21', 'name': 'network-vif-deleted', 'tag': '4e092f78-701d-48e1-8837-664198422e8e', 'status': 'completed', 'code': 200} Feb 17 18:10:05.825916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-8350b89f-46e3-42b9-a31f-490f34bd866f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for floatingip, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:05.879075 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-8350b89f-46e3-42b9-a31f-490f34bd866f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036854376515'] for floatingip, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:06.092023 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-938a3901-4892-4198-9b1f-cc25071d5e85 req-043e7075-be58-4254-8bae-c61461996758 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:06.093678 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-938a3901-4892-4198-9b1f-cc25071d5e85 req-043e7075-be58-4254-8bae-c61461996758 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.2588396 Feb 17 18:10:06.102010 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.l3_db [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-8350b89f-46e3-42b9-a31f-490f34bd866f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Floating IP d16e92b6-080c-4b6e-b2ce-a52b5f44c6fe associated. External IP: 172.27.1.226, port: e5b8b8b3-6466-4164-8a2d-7627684ce9d0. Feb 17 18:10:06.290756 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-938a3901-4892-4198-9b1f-cc25071d5e85 req-fc71a78f-bae6-4e0d-bb35-abdb73326fb1 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1902332 Feb 17 18:10:06.739362 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-86eb4bc9-fec8-429d-87ab-ad3ff8560bf4 req-4e575aae-c73a-4824-9b08-257fa50074a0 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 210 time: 0.0600603 Feb 17 18:10:06.787701 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-8350b89f-46e3-42b9-a31f-490f34bd866f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Router 742dfc39-339a-428f-8a3f-88d236afaaf4 has already been hosted by L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b {{(pid=84111) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:130}} Feb 17 18:10:07.099584 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-8350b89f-46e3-42b9-a31f-490f34bd866f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84111) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:10:07.099584 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ca2e68-d067-45c5-9973-f895eec7a317 req-5795b4c4-0608-4181-83cd-c0195166372c tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:07.099584 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e1ca2e68-d067-45c5-9973-f895eec7a317 req-5795b4c4-0608-4181-83cd-c0195166372c tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1511760 Feb 17 18:10:07.099584 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-8350b89f-46e3-42b9-a31f-490f34bd866f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for floatingip, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:07.101534 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96c940fc-aafc-4747-b2cc-60a9b0932ee5 None None] Sync routers for ids ['742dfc39-339a-428f-8a3f-88d236afaaf4'] in dv-cinder-760194-3-iscsi {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:10:07.101534 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96c940fc-aafc-4747-b2cc-60a9b0932ee5 None None] Routers {'742dfc39-339a-428f-8a3f-88d236afaaf4'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:10:07.101534 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-96c940fc-aafc-4747-b2cc-60a9b0932ee5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:09:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['742dfc39-339a-428f-8a3f-88d236afaaf4'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:07.179101 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e1ca2e68-d067-45c5-9973-f895eec7a317 req-d53ae8d5-f706-41be-a9b9-ac7d4df84371 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0746713 Feb 17 18:10:07.211292 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-8350b89f-46e3-42b9-a31f-490f34bd866f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "PUT /v2.0/floatingips/d16e92b6-080c-4b6e-b2ce-a52b5f44c6fe HTTP/1.1" status: 200 len: 996 time: 2.5216968 Feb 17 18:10:07.211976 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:10:07.302079 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0', 'status': 'completed', 'code': 200} Feb 17 18:10:07.320571 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-96c940fc-aafc-4747-b2cc-60a9b0932ee5 None None] Set router 742dfc39-339a-428f-8a3f-88d236afaaf4 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:10:07.360685 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-005edc73-8411-4d11-8270-32ddcd75dbe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:07.363250 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-005edc73-8411-4d11-8270-32ddcd75dbe5 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=5729c656e2c64606a663d6434a5c3973&device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 1162 time: 0.1280265 Feb 17 18:10:07.646030 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-eea5439c-3c10-4072-b212-2e06d4254c35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:07.648231 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-eea5439c-3c10-4072-b212-2e06d4254c35 service neutron] 10.222.0.13 "GET /v2.0/networks?id=6755b14b-f6f6-43aa-a697-3921175c5230 HTTP/1.1" status: 200 len: 909 time: 0.2784250 Feb 17 18:10:07.660870 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-387847b8-069a-4e61-b76d-06826cfdb503 req-5c5fa159-8a4a-4b49-9bca-fd2f05fe1ef9 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:07.671734 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-387847b8-069a-4e61-b76d-06826cfdb503 req-5c5fa159-8a4a-4b49-9bca-fd2f05fe1ef9 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.1770077 Feb 17 18:10:07.699047 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a18e6f51-c731-4936-a19a-ff37ca856b32 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:07.764651 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-96c940fc-aafc-4747-b2cc-60a9b0932ee5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:08:48Z', 'revision_number': 4, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_floatingips': [{'id': 'd16e92b6-080c-4b6e-b2ce-a52b5f44c6fe', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'floating_ip_address': '172.27.1.226', 'floating_network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'router_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'port_id': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'mac_address': 'fa:16:3e:74:37:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-02-17T18:10:02Z', 'updated_at': '2021-02-17T18:10:05Z', 'revision_number': 1, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'babc7f9f-a62e-4d31-9f66-a2e5ad339378', 'name': '', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'mac_address': 'fa:16:3e:6a:c4:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:47Z', 'updated_at': '2021-02-17T18:08:59Z', 'revision_number': 5, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'subnets': [{'id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:07.775713 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96c940fc-aafc-4747-b2cc-60a9b0932ee5 None None] Checking router: 742dfc39-339a-428f-8a3f-88d236afaaf4 for host: dv-cinder-760194-3-iscsi {{(pid=84114) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:10:07.785364 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96c940fc-aafc-4747-b2cc-60a9b0932ee5 None None] Routers {'742dfc39-339a-428f-8a3f-88d236afaaf4'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:10:07.786036 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-96c940fc-aafc-4747-b2cc-60a9b0932ee5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:09:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['742dfc39-339a-428f-8a3f-88d236afaaf4'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:07.826219 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-8356f8cb-8191-47d1-94bc-4004e4da4168 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 999 time: 0.1529994 Feb 17 18:10:07.829260 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-387847b8-069a-4e61-b76d-06826cfdb503 req-7aece0be-295e-402f-a419-2780fd159b93 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0595632 Feb 17 18:10:07.941245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-9de0efee-ee63-42ea-b4f9-0c1353660003 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:07.950021 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-9de0efee-ee63-42ea-b4f9-0c1353660003 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=8a96f440-286f-407f-9d7e-b3b2727a69a9 HTTP/1.1" status: 200 len: 854 time: 0.1159766 Feb 17 18:10:07.999244 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-96c940fc-aafc-4747-b2cc-60a9b0932ee5 None None] Set router 742dfc39-339a-428f-8a3f-88d236afaaf4 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:10:08.084627 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-46fd9baf-2c57-4493-98d5-63ccb363944a req-251d2436-d7ca-40a1-87b7-2e3e388201de tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 210 time: 0.0824964 Feb 17 18:10:08.115920 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-4eb4e6af-437f-474a-9bb2-b2977eb07ec6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:08.133607 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-4eb4e6af-437f-474a-9bb2-b2977eb07ec6 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=6755b14b-f6f6-43aa-a697-3921175c5230&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1824915 Feb 17 18:10:08.139056 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-1fe97f6a-3912-43f2-9d7b-6ca7bb1588a6 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=84111) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 17 18:10:08.140157 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-1fe97f6a-3912-43f2-9d7b-6ca7bb1588a6 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13455 time: 0.0056891 Feb 17 18:10:08.291633 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-cd4be463-a36a-4faa-99d8-7954b736a3e1 service neutron] 10.222.0.13 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1444054 Feb 17 18:10:08.435416 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-96c940fc-aafc-4747-b2cc-60a9b0932ee5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:08:48Z', 'revision_number': 4, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_floatingips': [{'id': 'd16e92b6-080c-4b6e-b2ce-a52b5f44c6fe', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'floating_ip_address': '172.27.1.226', 'floating_network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'router_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'port_id': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'mac_address': 'fa:16:3e:74:37:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-02-17T18:10:02Z', 'updated_at': '2021-02-17T18:10:05Z', 'revision_number': 1, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'babc7f9f-a62e-4d31-9f66-a2e5ad339378', 'name': '', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'mac_address': 'fa:16:3e:6a:c4:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:47Z', 'updated_at': '2021-02-17T18:08:59Z', 'revision_number': 5, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'subnets': [{'id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:08.441036 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96c940fc-aafc-4747-b2cc-60a9b0932ee5 None None] The sync data for ids ['742dfc39-339a-428f-8a3f-88d236afaaf4'] in dv-cinder-760194-3-iscsi is: [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:08:48Z', 'revision_number': 4, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_floatingips': [{'id': 'd16e92b6-080c-4b6e-b2ce-a52b5f44c6fe', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'floating_ip_address': '172.27.1.226', 'floating_network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'router_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'port_id': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'mac_address': 'fa:16:3e:74:37:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-02-17T18:10:02Z', 'updated_at': '2021-02-17T18:10:05Z', 'revision_number': 1, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'babc7f9f-a62e-4d31-9f66-a2e5ad339378', 'name': '', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'mac_address': 'fa:16:3e:6a:c4:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:47Z', 'updated_at': '2021-02-17T18:08:59Z', 'revision_number': 5, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'subnets': [{'id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}] {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:10:08.533491 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-49d12c22-06a8-476a-ae8f-23ec52b61b96 req-c257d1a3-9f15-45f4-a5e1-1ea7cae64d76 service neutron] 10.222.0.13 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2343497 Feb 17 18:10:08.573558 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23c4fca7-8095-4bbd-aa14-e43f718b3ff4 req-f7c5f8d0-c160-4196-bd43-064067299d63 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:08.573558 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-23c4fca7-8095-4bbd-aa14-e43f718b3ff4 req-f7c5f8d0-c160-4196-bd43-064067299d63 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1527946 Feb 17 18:10:08.624424 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-23c4fca7-8095-4bbd-aa14-e43f718b3ff4 req-f0331045-9529-438b-b7b0-226f1f1f14b3 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705397 Feb 17 18:10:08.648988 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Request body: {'security_group': {'name': 'tempest-TestMinimumBasicScenario-721487347', 'description': 'tempest-TestMinimumBasicScenario-721487347 description'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:10:08.655934 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:10:08.660807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Usage tracker for resource:security_group and tenant:5729c656e2c64606a663d6434a5c3973 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:10:08.663832 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:10:08.669686 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:10:08.698705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:08.723515 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:10:08.727698 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Usage tracker for resource:security_group_rule and tenant:5729c656e2c64606a663d6434a5c3973 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:10:08.730881 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:10:08.736836 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:10:08.857513 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f785cf1c-8777-47e7-b7a9-ebf291bf3ce3 None None] New status for floating IP d16e92b6-080c-4b6e-b2ce-a52b5f44c6fe: ACTIVE {{(pid=84113) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:272}} Feb 17 18:10:08.864368 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:08.893072 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:08.900623 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ef1f3c2a-49ad-4d0b-ac57-12c3b9397897 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:08.959110 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Pushing event updated for resources: {'SecurityGroup': ['ID=72d18d1b-1457-452a-9e65-49d155c0fafe,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:08.963775 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:08.967404 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:08.968759 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d9872e80-3918-4918-82f0-74da2d2aa2bf req-78c7b419-c475-468e-8e04-b0246d462476 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1817 time: 0.3252597 Feb 17 18:10:09.115894 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-933a77c4-6656-4924-b017-e4fc1a5fc298 req-1abc77a4-97b6-4f70-8f30-5a4593030df2 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups/72d18d1b-1457-452a-9e65-49d155c0fafe HTTP/1.1" status: 200 len: 1812 time: 0.0802395 Feb 17 18:10:09.130213 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20744cce-efd4-45f1-bf6c-cda517dc4c59 req-ae113b04-aff2-49e3-8fd6-9f4452e12409 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:09.131810 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-20744cce-efd4-45f1-bf6c-cda517dc4c59 req-ae113b04-aff2-49e3-8fd6-9f4452e12409 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.1459739 Feb 17 18:10:09.137451 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-933a77c4-6656-4924-b017-e4fc1a5fc298 req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '72d18d1b-1457-452a-9e65-49d155c0fafe', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:10:09.137451 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-933a77c4-6656-4924-b017-e4fc1a5fc298 req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '72d18d1b-1457-452a-9e65-49d155c0fafe', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:10:09.143537 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-933a77c4-6656-4924-b017-e4fc1a5fc298 req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:10:09.164269 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-933a77c4-6656-4924-b017-e4fc1a5fc298 req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Usage tracker for resource:security_group_rule and tenant:5729c656e2c64606a663d6434a5c3973 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:10:09.169845 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-933a77c4-6656-4924-b017-e4fc1a5fc298 req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:10:09.178688 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-933a77c4-6656-4924-b017-e4fc1a5fc298 req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:10:09.204751 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-20744cce-efd4-45f1-bf6c-cda517dc4c59 req-f17a3415-0cd7-40ab-97c0-d6256fa3f076 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0624752 Feb 17 18:10:09.287210 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-933a77c4-6656-4924-b017-e4fc1a5fc298 req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for security_group_rule, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:09.323518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-933a77c4-6656-4924-b017-e4fc1a5fc298 req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:09.378432 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-933a77c4-6656-4924-b017-e4fc1a5fc298 req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629551'] for security_group_rule, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:09.385591 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:09.393453 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b2c94463-ec25-4303-a3e3-36f02c5f1fa3 req-efd0f3eb-5141-4b49-8910-090dae2f5a0b tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 210 time: 0.0576148 Feb 17 18:10:09.416087 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=769e936a-5a31-48b3-a7b3-574158ed779b,revision_number=0']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:09.422213 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:09.452969 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-933a77c4-6656-4924-b017-e4fc1a5fc298 req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for security_group_rule, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:09.454296 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-933a77c4-6656-4924-b017-e4fc1a5fc298 req-59652276-3dc3-4a99-b7cb-a57fd3b9df00 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.3309236 Feb 17 18:10:09.527393 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d9f09bfe-b69e-42ff-a04a-0d99c6e9357d req-5988b50f-3801-45a5-89aa-574a5dfdab51 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups/72d18d1b-1457-452a-9e65-49d155c0fafe HTTP/1.1" status: 200 len: 2405 time: 0.0501375 Feb 17 18:10:09.539152 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-d9f09bfe-b69e-42ff-a04a-0d99c6e9357d req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'icmp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '72d18d1b-1457-452a-9e65-49d155c0fafe', 'remote_group_id': None}]} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:10:09.539512 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-d9f09bfe-b69e-42ff-a04a-0d99c6e9357d req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'icmp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '72d18d1b-1457-452a-9e65-49d155c0fafe', 'remote_group_id': None}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:10:09.545948 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-d9f09bfe-b69e-42ff-a04a-0d99c6e9357d req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:10:09.550680 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-d9f09bfe-b69e-42ff-a04a-0d99c6e9357d req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Usage tracker for resource:security_group_rule and tenant:5729c656e2c64606a663d6434a5c3973 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:10:09.553816 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-d9f09bfe-b69e-42ff-a04a-0d99c6e9357d req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:10:09.559807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-d9f09bfe-b69e-42ff-a04a-0d99c6e9357d req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:10:09.691139 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-d9f09bfe-b69e-42ff-a04a-0d99c6e9357d req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for security_group_rule, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:09.719021 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-d9f09bfe-b69e-42ff-a04a-0d99c6e9357d req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:09.824459 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e87b93df-b8da-4708-bff0-55bfe621f489 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:09.827660 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-d9f09bfe-b69e-42ff-a04a-0d99c6e9357d req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629551'] for security_group_rule, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:09.838994 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:09.875233 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=20a47b59-faf7-4ba6-8f1d-ec752134e8be,revision_number=0']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:09.883246 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:09.899332 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-845851b0-9105-42a2-bfa6-ffe3302c9144 req-4c53597f-d256-4cf5-aa3e-314beaf19cff tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:09.900949 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-845851b0-9105-42a2-bfa6-ffe3302c9144 req-4c53597f-d256-4cf5-aa3e-314beaf19cff tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1471515 Feb 17 18:10:09.902389 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-d9f09bfe-b69e-42ff-a04a-0d99c6e9357d req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for security_group_rule, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:09.903702 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d9f09bfe-b69e-42ff-a04a-0d99c6e9357d req-ef5556fa-5ee6-4b29-ad68-d0b24ee8e569 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 791 time: 0.3695588 Feb 17 18:10:09.971306 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-845851b0-9105-42a2-bfa6-ffe3302c9144 req-acf3a4b6-5ba1-4cc7-946f-c60d0bd90e16 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523553 Feb 17 18:10:10.058687 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-fa5c6aec-7e40-418b-8e6c-4578a20144a5 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Synchronizing usage tracker for tenant:5729c656e2c64606a663d6434a5c3973 on resource:security_group {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:10:10.110039 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-fa5c6aec-7e40-418b-8e6c-4578a20144a5 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Unset dirty status for tenant:5729c656e2c64606a663d6434a5c3973 on resource:security_group {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:10:10.111318 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-fa5c6aec-7e40-418b-8e6c-4578a20144a5 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-TestMinimumBasicScenario-721487347&fields=id&tenant_id=5729c656e2c64606a663d6434a5c3973 HTTP/1.1" status: 200 len: 267 time: 0.1056576 Feb 17 18:10:10.208307 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-61874ab0-ed8c-40e8-971c-9f5f820d1968 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:10.209899 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-61874ab0-ed8c-40e8-971c-9f5f820d1968 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.0923927 Feb 17 18:10:10.222630 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-32ba9edf-69d8-4896-8547-a6016775e880 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Request body: {'port': {'security_groups': ['d20c28cb-f883-4a6f-897a-3150a1a1bbfe', '72d18d1b-1457-452a-9e65-49d155c0fafe']}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:10:10.418918 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-32ba9edf-69d8-4896-8547-a6016775e880 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:10.565168 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888de50e-7326-48c2-a171-dc21fb5d2517 req-ee0fa541-a964-40d1-b00b-58f981502123 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:10.567387 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-888de50e-7326-48c2-a171-dc21fb5d2517 req-ee0fa541-a964-40d1-b00b-58f981502123 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.2115262 Feb 17 18:10:10.660225 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-888de50e-7326-48c2-a171-dc21fb5d2517 req-e3cd9503-8c91-43c3-9d4c-a2651b76f2a6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0742292 Feb 17 18:10:10.835853 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:11.023899 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-332208c6-3458-4d0d-8793-9f8758c22a08 req-4c008d40-51a1-4e49-8090-0a26be3cd868 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 210 time: 0.0645227 Feb 17 18:10:11.095318 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-32ba9edf-69d8-4896-8547-a6016775e880 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] For port e5b8b8b3-6466-4164-8a2d-7627684ce9d0, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0,segment=NetworkSegment(26bc7590-668d-4f62-883e-3f8e0fb997b0),segment_id=26bc7590-668d-4f62-883e-3f8e0fb997b0)] {{(pid=84111) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:10:11.134916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-32ba9edf-69d8-4896-8547-a6016775e880 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for port, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:11.194464 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-32ba9edf-69d8-4896-8547-a6016775e880 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4125045'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:11.218172 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:11.410762 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ba9edf-69d8-4896-8547-a6016775e880 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Pushing event updated for resources: {'Port': ['ID=e5b8b8b3-6466-4164-8a2d-7627684ce9d0,revision_number=5']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:11.414543 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-32ba9edf-69d8-4896-8547-a6016775e880 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:11.447763 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a84a6a5-74b9-4456-88e4-8814518fc7b9 req-d670919d-6dba-420d-99b2-e5108001b769 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:11.449530 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5a84a6a5-74b9-4456-88e4-8814518fc7b9 req-d670919d-6dba-420d-99b2-e5108001b769 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.2977450 Feb 17 18:10:11.486839 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-32ba9edf-69d8-4896-8547-a6016775e880 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:11.486839 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-32ba9edf-69d8-4896-8547-a6016775e880 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:11.487007 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-0c00a089-06de-4a56-8796-a14afd12bd25 req-32ba9edf-69d8-4896-8547-a6016775e880 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "PUT /v2.0/ports/e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 981 time: 1.2697351 Feb 17 18:10:11.489504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:10:11.528635 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-5a84a6a5-74b9-4456-88e4-8814518fc7b9 req-e90782db-5076-4c2c-beef-d709966c3ed5 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686083 Feb 17 18:10:11.719395 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0', 'status': 'completed', 'code': 200} Feb 17 18:10:11.772896 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee2798c3-1d32-4c53-a052-ed90d1b0900c req-8b88dd42-0ec5-4eb0-ade6-2c85b74a7378 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:11.772896 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ee2798c3-1d32-4c53-a052-ed90d1b0900c req-8b88dd42-0ec5-4eb0-ade6-2c85b74a7378 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.1572008 Feb 17 18:10:11.814638 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-273da953-10b5-4617-8e90-5c079546927b None None] Provisioning complete for port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:10:11.815308 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-273da953-10b5-4617-8e90-5c079546927b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:11.872919 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ee2798c3-1d32-4c53-a052-ed90d1b0900c req-6de3f9f1-6dda-4d3e-9fd0-294d44a237e8 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.1039124 Feb 17 18:10:11.921768 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d87946ae-c808-4e4d-9cda-07ff036fde52 req-e5554b26-e886-4a24-b005-8b46800532ec tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:11.923387 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d87946ae-c808-4e4d-9cda-07ff036fde52 req-e5554b26-e886-4a24-b005-8b46800532ec tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.1180897 Feb 17 18:10:11.975844 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d87946ae-c808-4e4d-9cda-07ff036fde52 req-e500ee38-dd88-47a2-bbc4-9e9157a3c2e4 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456238 Feb 17 18:10:12.017824 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:12.204810 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cc6039e9-66cf-4238-8201-1370ebd5d60d req-867e057d-508e-471a-a95c-e152264d7798 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 210 time: 0.0543044 Feb 17 18:10:12.747988 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c35ff5-52e3-41a3-a329-a30677f86b45 req-6992bcde-d6a5-4205-bc83-024177a73301 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:12.749912 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e6c35ff5-52e3-41a3-a329-a30677f86b45 req-6992bcde-d6a5-4205-bc83-024177a73301 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1039951 Feb 17 18:10:12.766968 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:12.801319 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e6c35ff5-52e3-41a3-a329-a30677f86b45 req-24d52f98-3168-4bb6-be6a-8d24f10b769a tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451977 Feb 17 18:10:13.198818 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2478d84-8c6e-4ac8-acc9-67e5b245893a req-c39bf02b-c550-402e-91eb-fe583838edb8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:13.199050 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a2478d84-8c6e-4ac8-acc9-67e5b245893a req-c39bf02b-c550-402e-91eb-fe583838edb8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.0935228 Feb 17 18:10:13.251960 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a2478d84-8c6e-4ac8-acc9-67e5b245893a req-c7a325ee-7e1a-45a2-8bb5-1e342435910d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466468 Feb 17 18:10:13.394713 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e5b8b8b3-6466-4164-8a2d-7627684ce9d0 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:10:13.395657 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a60ce843-24e7-4ccf-b57e-7cc8f2203404 req-d08c7d37-4816-440d-b1ba-dc803ebc5361 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 210 time: 0.0508745 Feb 17 18:10:13.470984 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:10:13.471396 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:14.026414 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a116d5b0-1bf6-4cc9-a645-ec9b0ab2e049 req-60a7d481-68af-4d8d-8578-cf8a66ebf319 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:14.028067 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a116d5b0-1bf6-4cc9-a645-ec9b0ab2e049 req-60a7d481-68af-4d8d-8578-cf8a66ebf319 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.0918000 Feb 17 18:10:14.081639 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a116d5b0-1bf6-4cc9-a645-ec9b0ab2e049 req-b8b00de5-d386-46c8-9874-23252fc16fa8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471632 Feb 17 18:10:14.474227 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e74f5fba-767b-44d3-9114-f21e094e277d req-ba12a573-516a-4ff5-b36a-2f423e21d65f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:14.475934 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e74f5fba-767b-44d3-9114-f21e094e277d req-ba12a573-516a-4ff5-b36a-2f423e21d65f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.0957468 Feb 17 18:10:14.585230 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f91fe1b7-1d4c-45c0-9f69-0430dd8873db req-c9dd85ab-0252-489e-9f89-ed3fb8bd8c87 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 210 time: 0.0663490 Feb 17 18:10:14.593682 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e74f5fba-767b-44d3-9114-f21e094e277d req-895f4932-1a90-4b50-b5b7-e8d71fd82724 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1091471 Feb 17 18:10:15.292422 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f634a33-ad1e-4e02-9951-5cbf086f39a2 req-d346f391-39bf-4119-950b-b758794d745a tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:15.294079 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3f634a33-ad1e-4e02-9951-5cbf086f39a2 req-d346f391-39bf-4119-950b-b758794d745a tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.0908837 Feb 17 18:10:15.344913 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3f634a33-ad1e-4e02-9951-5cbf086f39a2 req-eb45381a-f7d8-42c2-9212-67a1a5a0d955 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442731 Feb 17 18:10:15.584899 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 58506) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:15.712968 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3c44fc63-7100-458a-ac17-9055fa0f6d5f admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:15.729066 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-3c44fc63-7100-458a-ac17-9055fa0f6d5f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:10:15.733170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-3c44fc63-7100-458a-ac17-9055fa0f6d5f admin admin] Usage tracker for resource:security_group_rule and tenant:2244d5517afa4097b41a0a02cb3d8a8d is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:10:15.736153 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-3c44fc63-7100-458a-ac17-9055fa0f6d5f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:10:15.742412 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-3c44fc63-7100-458a-ac17-9055fa0f6d5f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:10:15.798870 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-27b22684-c07c-4e52-9820-661f4bb81024 req-2e13baf2-a7c6-42f5-ac2e-dface0a0b120 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=c13a0fb6-558a-4c45-afa0-ed7e0da69c21 HTTP/1.1" status: 200 len: 210 time: 0.0866032 Feb 17 18:10:15.848815 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-599a899f-7458-4e5a-b8dd-7e3781de0b7d req-9c2d7341-c556-4000-9a39-fc2c9d8e50a5 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:15.850424 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-599a899f-7458-4e5a-b8dd-7e3781de0b7d req-9c2d7341-c556-4000-9a39-fc2c9d8e50a5 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.0922492 Feb 17 18:10:15.900283 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-599a899f-7458-4e5a-b8dd-7e3781de0b7d req-1b5a75da-19b8-4d29-9bd1-ae614210cc71 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428958 Feb 17 18:10:15.900503 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3c44fc63-7100-458a-ac17-9055fa0f6d5f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:15.964877 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3c44fc63-7100-458a-ac17-9055fa0f6d5f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:15.979466 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c72c98df-f834-4f8d-87b4-40c342896f1d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:16.036385 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3c44fc63-7100-458a-ac17-9055fa0f6d5f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2244d5517afa4097b41a0a02cb3d8a8d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4502916 Feb 17 18:10:16.037329 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c44fc63-7100-458a-ac17-9055fa0f6d5f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5cfb186c-f56d-4d05-a57b-eecf641bb83b,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:16.040178 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 58516) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:16.041072 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3c44fc63-7100-458a-ac17-9055fa0f6d5f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:16.058410 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec0c37b9-e59f-463b-bf2f-43018f70aeab req-63efef04-91cd-4f92-88fe-25cb36c7498d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:16.060101 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ec0c37b9-e59f-463b-bf2f-43018f70aeab req-63efef04-91cd-4f92-88fe-25cb36c7498d service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=5729c656e2c64606a663d6434a5c3973&device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 1202 time: 0.1396804 Feb 17 18:10:16.106568 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-13660967-0bbd-4a37-86d4-d0e3cb7ad041 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:16.134412 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-13660967-0bbd-4a37-86d4-d0e3cb7ad041 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:16.209762 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec0c37b9-e59f-463b-bf2f-43018f70aeab req-98d3c7b3-d3ee-4d1d-a0bf-f701969b30a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:16.211285 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ec0c37b9-e59f-463b-bf2f-43018f70aeab req-98d3c7b3-d3ee-4d1d-a0bf-f701969b30a9 service neutron] 10.222.0.70 "GET /v2.0/networks?id=6755b14b-f6f6-43aa-a697-3921175c5230 HTTP/1.1" status: 200 len: 909 time: 0.1401515 Feb 17 18:10:16.275503 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-13660967-0bbd-4a37-86d4-d0e3cb7ad041 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:16.280744 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b95ff068-b7c6-4bdd-8ec1-ac644df1209e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:16.295316 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13660967-0bbd-4a37-86d4-d0e3cb7ad041 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5cfb186c-f56d-4d05-a57b-eecf641bb83b,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:16.298225 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-13660967-0bbd-4a37-86d4-d0e3cb7ad041 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:16.301049 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-13660967-0bbd-4a37-86d4-d0e3cb7ad041 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:16.304927 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-13660967-0bbd-4a37-86d4-d0e3cb7ad041 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5cfb186c-f56d-4d05-a57b-eecf641bb83b HTTP/1.1" status: 204 len: 168 time: 0.2617373 Feb 17 18:10:16.338662 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ec0c37b9-e59f-463b-bf2f-43018f70aeab req-1e93aad3-1473-41cd-a369-c70affa41427 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 1001 time: 0.1074817 Feb 17 18:10:16.411453 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec0c37b9-e59f-463b-bf2f-43018f70aeab req-a92613f1-6b12-4ce4-be5f-ad3d417d3651 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:16.413084 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ec0c37b9-e59f-463b-bf2f-43018f70aeab req-a92613f1-6b12-4ce4-be5f-ad3d417d3651 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=8a96f440-286f-407f-9d7e-b3b2727a69a9 HTTP/1.1" status: 200 len: 854 time: 0.0667551 Feb 17 18:10:16.502309 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec0c37b9-e59f-463b-bf2f-43018f70aeab req-f551b6f1-22f1-4bba-8477-252e440e7a76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:16.504572 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ec0c37b9-e59f-463b-bf2f-43018f70aeab req-f551b6f1-22f1-4bba-8477-252e440e7a76 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=6755b14b-f6f6-43aa-a697-3921175c5230&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0841293 Feb 17 18:10:16.563205 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82077520-01d1-4d9a-b59d-1e2ff23c2afa req-7c6d3f8d-9472-4e1e-b5ad-d08cb9ec053b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:16.564967 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-82077520-01d1-4d9a-b59d-1e2ff23c2afa req-7c6d3f8d-9472-4e1e-b5ad-d08cb9ec053b tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1041381 Feb 17 18:10:16.651287 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-82077520-01d1-4d9a-b59d-1e2ff23c2afa req-2f584247-2266-4a07-b7d7-795cb9311132 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714214 Feb 17 18:10:16.688289 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ec0c37b9-e59f-463b-bf2f-43018f70aeab req-83a53412-dc9a-4580-a714-85bfe10f0b4c service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1734724 Feb 17 18:10:16.833370 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ec0c37b9-e59f-463b-bf2f-43018f70aeab req-f20d87ca-580d-4a7e-85e2-72639f71788f service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1368144 Feb 17 18:10:16.958893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f611d14c-0ee8-4f07-90d5-ae81c6f01a87 req-4742d645-09ad-4641-ab29-a96243c05f53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:16.960697 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f611d14c-0ee8-4f07-90d5-ae81c6f01a87 req-4742d645-09ad-4641-ab29-a96243c05f53 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=5729c656e2c64606a663d6434a5c3973&device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 1202 time: 0.0783989 Feb 17 18:10:17.109800 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f611d14c-0ee8-4f07-90d5-ae81c6f01a87 req-f214647b-8d7f-4b55-9959-ac15bc5577b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:17.111518 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f611d14c-0ee8-4f07-90d5-ae81c6f01a87 req-f214647b-8d7f-4b55-9959-ac15bc5577b2 service neutron] 10.222.0.70 "GET /v2.0/networks?id=6755b14b-f6f6-43aa-a697-3921175c5230 HTTP/1.1" status: 200 len: 909 time: 0.1436470 Feb 17 18:10:17.113325 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58dc7c73-3f33-40bc-b67e-23af1bc77df6 req-9847a058-9cd9-4594-aaf9-97add53a5b5b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:17.114964 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-58dc7c73-3f33-40bc-b67e-23af1bc77df6 req-9847a058-9cd9-4594-aaf9-97add53a5b5b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.0917900 Feb 17 18:10:17.164671 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-58dc7c73-3f33-40bc-b67e-23af1bc77df6 req-1d075932-08ec-4a6f-88f8-2c2bb9c8adac tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432694 Feb 17 18:10:17.426922 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f611d14c-0ee8-4f07-90d5-ae81c6f01a87 req-6680d472-a449-450c-93a5-e71b7a0c678b service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 1001 time: 0.3078494 Feb 17 18:10:17.498355 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f611d14c-0ee8-4f07-90d5-ae81c6f01a87 req-450bcbe6-9738-46f8-9cd7-515d1b897564 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:17.499922 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f611d14c-0ee8-4f07-90d5-ae81c6f01a87 req-450bcbe6-9738-46f8-9cd7-515d1b897564 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=8a96f440-286f-407f-9d7e-b3b2727a69a9 HTTP/1.1" status: 200 len: 854 time: 0.0658264 Feb 17 18:10:17.580704 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f611d14c-0ee8-4f07-90d5-ae81c6f01a87 req-0a2394ce-e999-41e8-af77-5704109b3d5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:17.583033 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f611d14c-0ee8-4f07-90d5-ae81c6f01a87 req-0a2394ce-e999-41e8-af77-5704109b3d5b service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=6755b14b-f6f6-43aa-a697-3921175c5230&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0762122 Feb 17 18:10:17.720594 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:17.727486 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f611d14c-0ee8-4f07-90d5-ae81c6f01a87 req-3b3cbba9-05a6-4347-8bd0-6ba5a46ac94b service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1356170 Feb 17 18:10:17.864604 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8721a536-f17b-400d-8ec7-8008b277c1bf req-9b619e7c-88b9-4401-915e-823310f1cff1 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:17.866188 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8721a536-f17b-400d-8ec7-8008b277c1bf req-9b619e7c-88b9-4401-915e-823310f1cff1 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.0884323 Feb 17 18:10:17.872791 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f611d14c-0ee8-4f07-90d5-ae81c6f01a87 req-96896028-b7c8-44dd-a654-8adfb3a8a08c service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1357660 Feb 17 18:10:17.915254 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8721a536-f17b-400d-8ec7-8008b277c1bf req-07dfd7d1-2af3-433d-8aef-d06ecbac4734 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427611 Feb 17 18:10:18.379844 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4616e52f-60ab-4aa5-8d64-a8db9e4e5661 req-60c3c8fe-6b06-4f5a-a0b8-cc570f324bfc tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:18.381489 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4616e52f-60ab-4aa5-8d64-a8db9e4e5661 req-60c3c8fe-6b06-4f5a-a0b8-cc570f324bfc tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.0954056 Feb 17 18:10:18.432341 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4616e52f-60ab-4aa5-8d64-a8db9e4e5661 req-ac4ab141-5566-4c02-9877-5aabdc77660d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444496 Feb 17 18:10:18.669546 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ea74981-c49c-485c-b898-12dc8cf52ddd req-389208d9-d3ca-4626-a879-66d75d95af3c tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:18.671134 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3ea74981-c49c-485c-b898-12dc8cf52ddd req-389208d9-d3ca-4626-a879-66d75d95af3c tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 946 time: 0.0855119 Feb 17 18:10:18.720512 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3ea74981-c49c-485c-b898-12dc8cf52ddd req-3f1cc102-38ec-4422-89f7-97ed7b3091cb tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423629 Feb 17 18:10:18.920270 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-2be4440c-37cb-4a7c-9a06-8445678b1dc2 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84112) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:18.921030 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-2be4440c-37cb-4a7c-9a06-8445678b1dc2 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Synchronizing usage tracker for tenant:bda7a35e855840d7bc75e16e402f3690 on resource:port {{(pid=84112) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:10:18.961153 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-2be4440c-37cb-4a7c-9a06-8445678b1dc2 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Unset dirty status for tenant:bda7a35e855840d7bc75e16e402f3690 on resource:port {{(pid=84112) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:10:18.962397 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-2be4440c-37cb-4a7c-9a06-8445678b1dc2 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.70 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.1302195 Feb 17 18:10:19.041138 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Deleting port bb98aa49-1c81-4cea-99cf-f201d19cfdae {{(pid=84112) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:10:19.041523 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:19.118881 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-846a7167-16a6-460a-80db-599662dcb461 req-e386524e-2cfe-43f1-b5ce-08eac65b13da tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:19.120596 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-846a7167-16a6-460a-80db-599662dcb461 req-e386524e-2cfe-43f1-b5ce-08eac65b13da tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 945 time: 0.0902328 Feb 17 18:10:19.168399 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-846a7167-16a6-460a-80db-599662dcb461 req-12f9b389-09ec-4779-9a2f-3326891b620e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413857 Feb 17 18:10:19.193333 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device bb98aa49-1c81-4cea-99cf-f201d19cfdae no longer exists at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:10:19.308625 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] For port bb98aa49-1c81-4cea-99cf-f201d19cfdae, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=bb98aa49-1c81-4cea-99cf-f201d19cfdae,segment=NetworkSegment(eaf585ce-3bb4-4c27-942c-8aa396958840),segment_id=eaf585ce-3bb4-4c27-942c-8aa396958840)] {{(pid=84112) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:10:19.308958 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:19.316899 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:19.344889 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf9e5a61-4f98-4cce-9af7-0a007d3afc36', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bb98aa49-1c81-4cea-99cf-f201d19cfdae'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:10:19.355999 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port bb98aa49-1c81-4cea-99cf-f201d19cfdae, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=bb98aa49-1c81-4cea-99cf-f201d19cfdae,segment=NetworkSegment(eaf585ce-3bb4-4c27-942c-8aa396958840),segment_id=eaf585ce-3bb4-4c27-942c-8aa396958840)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:10:19.389786 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:19.393003 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf9e5a61-4f98-4cce-9af7-0a007d3afc36', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bb98aa49-1c81-4cea-99cf-f201d19cfdae', 'code': 200} Feb 17 18:10:19.393582 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a85c2308-1879-4314-8871-f992029f6a22 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:19.445714 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Calling delete_port for bb98aa49-1c81-4cea-99cf-f201d19cfdae owned by compute:nova {{(pid=84112) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:10:19.464043 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=bb98aa49-1c81-4cea-99cf-f201d19cfdae,revision_number=5']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:19.467985 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:19.561655 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.db.api [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=84112) wrapped /usr/local/lib/python3.6/dist-packages/neutron_lib/db/api.py:183}} Feb 17 18:10:19.561952 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_db.api [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_db/api.py:156}} Feb 17 18:10:19.639402 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee222b1-b670-407c-b949-5fe0f8416296 req-43621506-f3da-4dd3-b539-384c025275e2 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:19.641052 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-aee222b1-b670-407c-b949-5fe0f8416296 req-43621506-f3da-4dd3-b539-384c025275e2 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.0855293 Feb 17 18:10:19.691792 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-aee222b1-b670-407c-b949-5fe0f8416296 req-28c244f1-bb8d-49cf-893c-4f8a43fb9806 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440352 Feb 17 18:10:19.918732 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109568a8-ee78-4692-accd-4f85cc6b35f9 req-7b6b489a-10e1-4c74-9fa7-baa9432fd33f tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:19.920361 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-109568a8-ee78-4692-accd-4f85cc6b35f9 req-7b6b489a-10e1-4c74-9fa7-baa9432fd33f tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 946 time: 0.0860586 Feb 17 18:10:19.967841 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-109568a8-ee78-4692-accd-4f85cc6b35f9 req-aae143cb-981b-492d-932c-b4aae5890e2f tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413704 Feb 17 18:10:20.062776 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Deleting port bb98aa49-1c81-4cea-99cf-f201d19cfdae {{(pid=84112) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:10:20.063168 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:20.326306 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] For port bb98aa49-1c81-4cea-99cf-f201d19cfdae, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=bb98aa49-1c81-4cea-99cf-f201d19cfdae,segment=NetworkSegment(eaf585ce-3bb4-4c27-942c-8aa396958840),segment_id=eaf585ce-3bb4-4c27-942c-8aa396958840)] {{(pid=84112) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:10:20.326700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:20.437262 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aa9e450-e694-4718-9916-30d521f3a94f req-c908065f-895a-4112-8d44-32ee47193aeb tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:20.438868 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9aa9e450-e694-4718-9916-30d521f3a94f req-c908065f-895a-4112-8d44-32ee47193aeb tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 943 time: 0.1567779 Feb 17 18:10:20.445461 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51078933-c66d-4659-9366-7fb6e1676455 req-80578084-940f-49bc-9096-7ff59a5b8085 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:20.446917 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-51078933-c66d-4659-9366-7fb6e1676455 req-80578084-940f-49bc-9096-7ff59a5b8085 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 946 time: 0.1628656 Feb 17 18:10:20.464875 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Calling delete_port for bb98aa49-1c81-4cea-99cf-f201d19cfdae owned by compute:nova {{(pid=84112) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:10:20.549997 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9aa9e450-e694-4718-9916-30d521f3a94f req-642ec3d5-5c43-480b-9ddf-48a221941b21 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1015110 Feb 17 18:10:20.558190 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-51078933-c66d-4659-9366-7fb6e1676455 req-8f744bb5-e510-4f40-be7f-c1adeee47124 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Deleting port b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 {{(pid=84111) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:10:20.558575 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-51078933-c66d-4659-9366-7fb6e1676455 req-8f744bb5-e510-4f40-be7f-c1adeee47124 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:20.646149 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:20.662649 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-83870f20-3f19-4a0b-b044-05a442ab250a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:20.760518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Pushing event deleted for resources: {'Port': ['ID=bb98aa49-1c81-4cea-99cf-f201d19cfdae,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:20.773041 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:20.871783 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] No DVR routers for this DVR port bb98aa49-1c81-4cea-99cf-f201d19cfdae on host hv-cinder-76019 {{(pid=84112) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Feb 17 18:10:20.874425 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:20.877170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf9e5a61-4f98-4cce-9af7-0a007d3afc36', 'name': 'network-vif-deleted', 'tag': 'bb98aa49-1c81-4cea-99cf-f201d19cfdae'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:10:20.884699 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-51078933-c66d-4659-9366-7fb6e1676455 req-8f744bb5-e510-4f40-be7f-c1adeee47124 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] For port b3a26ef4-a85c-4cec-a049-f4b7fa8c6375, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=b3a26ef4-a85c-4cec-a049-f4b7fa8c6375,segment=NetworkSegment(dc9d9960-339b-4f6e-a3d3-9084931321b3),segment_id=dc9d9960-339b-4f6e-a3d3-9084931321b3)] {{(pid=84111) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:10:20.885033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-51078933-c66d-4659-9366-7fb6e1676455 req-8f744bb5-e510-4f40-be7f-c1adeee47124 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:20.927838 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf9e5a61-4f98-4cce-9af7-0a007d3afc36', 'name': 'network-vif-deleted', 'tag': 'bb98aa49-1c81-4cea-99cf-f201d19cfdae', 'status': 'completed', 'code': 200} Feb 17 18:10:20.938962 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9c7e25cf-b3d2-44f6-9cd7-0f544f816b41 req-188c17f3-9967-4c93-a97a-f71e784e820d tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.70 "DELETE /v2.0/ports/bb98aa49-1c81-4cea-99cf-f201d19cfdae HTTP/1.1" status: 204 len: 173 time: 1.9696689 Feb 17 18:10:21.023270 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-51078933-c66d-4659-9366-7fb6e1676455 req-8f744bb5-e510-4f40-be7f-c1adeee47124 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Calling delete_port for b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 owned by compute:nova {{(pid=84111) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:10:21.149559 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94759057-0c80-48e1-a653-cd90a52e8bdc req-51d03f13-3b92-4edc-a519-db735d92674b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:21.151177 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94759057-0c80-48e1-a653-cd90a52e8bdc req-51d03f13-3b92-4edc-a519-db735d92674b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.3374233 Feb 17 18:10:21.282154 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94759057-0c80-48e1-a653-cd90a52e8bdc req-dc11d4a4-8f2a-4936-a19f-d699c3008f40 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1064596 Feb 17 18:10:21.306126 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cc0cea-46f6-4f00-a397-1d0b91980350 req-8195dccc-c539-4c67-9270-5bec4f344779 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:21.307699 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-10cc0cea-46f6-4f00-a397-1d0b91980350 req-8195dccc-c539-4c67-9270-5bec4f344779 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/ports?device_id=b8ff9d7a-1f7b-42c0-b8d1-1f882378df53 HTTP/1.1" status: 200 len: 946 time: 0.2216549 Feb 17 18:10:21.346807 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-51078933-c66d-4659-9366-7fb6e1676455 req-8f744bb5-e510-4f40-be7f-c1adeee47124 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:21.363349 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:21.366069 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 no longer exists at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:10:21.406354 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] No Port match for: b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:10:21.406748 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 not bound to the agent host hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:10:21.674067 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-10cc0cea-46f6-4f00-a397-1d0b91980350 req-ac5ed20e-c15b-4f0b-beeb-2ca1240b5cc6 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.13 "GET /v2.0/security-groups?id=d30a6557-543f-4cae-be17-0884747c77f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3598652 Feb 17 18:10:21.675461 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f744bb5-e510-4f40-be7f-c1adeee47124 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Pushing event deleted for resources: {'Port': ['ID=b3a26ef4-a85c-4cec-a049-f4b7fa8c6375,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:21.682809 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-8f744bb5-e510-4f40-be7f-c1adeee47124 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.319s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:21.748849 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f0ccccb1-2973-4dc6-9fc0-565692c76ccf req-b54e35d6-9cf1-4532-a561-e6f463478295 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=cf9e5a61-4f98-4cce-9af7-0a007d3afc36 HTTP/1.1" status: 200 len: 210 time: 0.0574636 Feb 17 18:10:21.840253 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-51078933-c66d-4659-9366-7fb6e1676455 req-8f744bb5-e510-4f40-be7f-c1adeee47124 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] No DVR routers for this DVR port b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 on host hv-cinder-76019 {{(pid=84111) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Feb 17 18:10:21.842366 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-51078933-c66d-4659-9366-7fb6e1676455 req-8f744bb5-e510-4f40-be7f-c1adeee47124 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:21.845911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b8ff9d7a-1f7b-42c0-b8d1-1f882378df53', 'name': 'network-vif-deleted', 'tag': 'b3a26ef4-a85c-4cec-a049-f4b7fa8c6375'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:10:21.859170 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-51078933-c66d-4659-9366-7fb6e1676455 req-8f744bb5-e510-4f40-be7f-c1adeee47124 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] 10.222.0.70 "DELETE /v2.0/ports/b3a26ef4-a85c-4cec-a049-f4b7fa8c6375 HTTP/1.1" status: 204 len: 173 time: 1.3972795 Feb 17 18:10:21.896368 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b8ff9d7a-1f7b-42c0-b8d1-1f882378df53', 'name': 'network-vif-deleted', 'tag': 'b3a26ef4-a85c-4cec-a049-f4b7fa8c6375', 'status': 'completed', 'code': 200} Feb 17 18:10:22.488761 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d4a0a4b-5744-43c8-b9a6-dcc7b2bc9a2e req-60808682-f829-486f-8320-5c7ef7715fe7 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:22.490409 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3d4a0a4b-5744-43c8-b9a6-dcc7b2bc9a2e req-60808682-f829-486f-8320-5c7ef7715fe7 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.0905888 Feb 17 18:10:22.537959 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3d4a0a4b-5744-43c8-b9a6-dcc7b2bc9a2e req-7669d473-f00f-4b81-a30b-ed71867038a8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412593 Feb 17 18:10:22.791500 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 58570) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:22.857972 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_v2 [None req-7808f585-2312-473d-8e72-37fc66bb4809 admin admin] Deleting subnet e1b65f5a-677d-4368-874f-50623d3454b9 {{(pid=84111) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1041}} Feb 17 18:10:22.861129 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7808f585-2312-473d-8e72-37fc66bb4809 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:22.917433 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7808f585-2312-473d-8e72-37fc66bb4809 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036852434851'] for subnet, precommit_delete_associations {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:22.976190 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7808f585-2312-473d-8e72-37fc66bb4809 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1550982'] for subnet, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:23.313841 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28a3d219-7ce1-49e9-b864-5acdd01653e0 req-21a94b07-4294-4e93-a318-3baa33fbc8e5 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:23.315474 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-28a3d219-7ce1-49e9-b864-5acdd01653e0 req-21a94b07-4294-4e93-a318-3baa33fbc8e5 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1058509 Feb 17 18:10:23.359306 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7808f585-2312-473d-8e72-37fc66bb4809 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853224802', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted--9223372036850649176', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9686835'] for subnet, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:23.376346 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-28a3d219-7ce1-49e9-b864-5acdd01653e0 req-0a35ea70-59dd-4a9c-bd22-eee7ae12d531 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544255 Feb 17 18:10:23.379312 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c89bf0bb-a4ad-488d-877c-89e5cf3b6c26 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:23.467190 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7808f585-2312-473d-8e72-37fc66bb4809 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e1b65f5a-677d-4368-874f-50623d3454b9,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:23.472189 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7808f585-2312-473d-8e72-37fc66bb4809 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:23.511656 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7808f585-2312-473d-8e72-37fc66bb4809 admin admin] Notify callbacks [] for subnet, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:23.517569 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-7808f585-2312-473d-8e72-37fc66bb4809 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/e1b65f5a-677d-4368-874f-50623d3454b9 HTTP/1.1" status: 204 len: 168 time: 0.7249522 Feb 17 18:10:23.520675 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 58578) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:23.636725 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1376323'] for network, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:23.638892 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:10:23.710404 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:10:23.710819 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:23.844171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:23.875142 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:10:23.886941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89,segment=NetworkSegment(a3b9a246-e8d6-47cc-bbb0-e0531b20a903),segment_id=a3b9a246-e8d6-47cc-bbb0-e0531b20a903)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:10:23.906131 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1551647', 'neutron.services.segments.db._delete_segments_for_network-8730056716045'] for network, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:23.922632 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:23.925815 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-852022a2-b6e5-4282-a660-803da5705671 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:23.981202 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89', 'code': 200} Feb 17 18:10:23.991412 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da682a0a-5072-4ff8-b635-f1a7eb3a40f3 req-d124166f-ce0c-41b0-afa0-4e8b3576c507 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:23.994609 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-da682a0a-5072-4ff8-b635-f1a7eb3a40f3 req-d124166f-ce0c-41b0-afa0-4e8b3576c507 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 943 time: 0.3012953 Feb 17 18:10:24.006135 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89,revision_number=6']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:24.009656 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:24.074684 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ee1c48e9-8681-4765-bc5b-bc0215d911a4']}} {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:24.088197 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-da682a0a-5072-4ff8-b635-f1a7eb3a40f3 req-98a1c480-77ed-470c-ae9c-3a6802cbd949 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0886106 Feb 17 18:10:24.091785 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dc9d9960-339b-4f6e-a3d3-9084931321b3') {'for_net_delete': True} {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:24.092273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dc9d9960-339b-4f6e-a3d3-9084931321b3') {} {{(pid=84111) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:24.104374 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8730056711181', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2340933'] for segment, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:24.195277 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:24.197499 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] Releasing vxlan tunnel 4 to pool {{(pid=84111) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:322}} Feb 17 18:10:24.377547 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] Network ee1c48e9-8681-4765-bc5b-bc0215d911a4 has no segments {{(pid=84111) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:10:24.386526 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1547159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4125015'] for segment, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:24.674452 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] Network ee1c48e9-8681-4765-bc5b-bc0215d911a4 has no segments {{(pid=84111) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: Traceback (most recent call last): Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: timer() Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: cb(*args, **kw) Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/common/utils.py", line 973, in wrapper Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: return func(*args, **kwargs) Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: self._notify() Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: self.callback(batched_events) Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: event.method(event) Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: segment_id)['aggregates'][0] Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: return f(self, *a, **k) Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: return self._get(url).json() Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: **kwargs) Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1131, in get Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: return self.request(url, 'GET', **kwargs) Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 802, in request Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: **endpoint_filter) Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 17 18:10:24.698888 dv-cinder-760194-3-iscsi neutron-server[84000]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 17 18:10:24.806739 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a3bcd7a-5407-40cd-88a3-79632b538aeb req-cc8761b8-3bce-4b37-b1db-746cdf994d7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:24.808371 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8a3bcd7a-5407-40cd-88a3-79632b538aeb req-cc8761b8-3bce-4b37-b1db-746cdf994d7a service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 1162 time: 0.2665002 Feb 17 18:10:24.815338 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0d6116d-1ccc-4332-8d90-18ae59131cf0 req-e49305d3-af9d-4180-bca7-4f5961638592 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:24.816910 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e0d6116d-1ccc-4332-8d90-18ae59131cf0 req-e49305d3-af9d-4180-bca7-4f5961638592 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.2762473 Feb 17 18:10:24.886544 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8a3bcd7a-5407-40cd-88a3-79632b538aeb req-7b42dc30-1341-4d1f-813c-2d5a19f47e9d service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0686386 Feb 17 18:10:24.891050 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e0d6116d-1ccc-4332-8d90-18ae59131cf0 req-8d0bebcf-d02d-4a1e-92b4-4e2d1119c611 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596111 Feb 17 18:10:24.926630 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853224169', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036854319422'] for network, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:24.930078 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:24.946178 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:24.954806 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] Pushing event deleted for resources: {'Network': ['ID=ee1c48e9-8681-4765-bc5b-bc0215d911a4,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:24.958690 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:25.001695 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-873e941d-df28-4248-b126-68b435aec76d admin admin] 10.222.0.13 "DELETE /v2.0/networks/ee1c48e9-8681-4765-bc5b-bc0215d911a4 HTTP/1.1" status: 204 len: 168 time: 1.4800365 Feb 17 18:10:25.251204 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 58594) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:25.261386 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:10:25.332632 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-b9323e58-49e3-45a8-aa8f-e1f4e3f589f8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c2e8792284c348238cf9afdcae0c221e&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0777524 Feb 17 18:10:25.333200 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 58598) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:25.336105 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:10:25.336534 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:25.345607 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f37e0ff5-b68b-4bc9-aa1b-857288a3310f req-b0ae5e49-1efe-4a20-a504-3816d0056335 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:25.347815 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f37e0ff5-b68b-4bc9-aa1b-857288a3310f req-b0ae5e49-1efe-4a20-a504-3816d0056335 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1392372 Feb 17 18:10:25.396887 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f37e0ff5-b68b-4bc9-aa1b-857288a3310f req-bd3f3811-fa12-4605-964c-7316507d3321 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425570 Feb 17 18:10:25.404482 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-267b3200-9a60-46aa-a504-11b3752d9652 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:25.433515 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-267b3200-9a60-46aa-a504-11b3752d9652 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:25.533149 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-267b3200-9a60-46aa-a504-11b3752d9652 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:25.539656 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-96ec1b19-cdc0-4072-80df-8ef22c5c5524 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:25.555407 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-267b3200-9a60-46aa-a504-11b3752d9652 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d30a6557-543f-4cae-be17-0884747c77f6,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:25.558365 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-267b3200-9a60-46aa-a504-11b3752d9652 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:25.560851 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-267b3200-9a60-46aa-a504-11b3752d9652 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:25.564656 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-267b3200-9a60-46aa-a504-11b3752d9652 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d30a6557-543f-4cae-be17-0884747c77f6 HTTP/1.1" status: 204 len: 168 time: 0.2275925 Feb 17 18:10:26.093313 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbfc55e7-d7b4-499f-8c41-4029a2d53f81 req-d4097f8e-8a49-4cb7-85e2-cd79b51a9be8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:26.095126 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cbfc55e7-d7b4-499f-8c41-4029a2d53f81 req-d4097f8e-8a49-4cb7-85e2-cd79b51a9be8 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0872648 Feb 17 18:10:26.148513 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cbfc55e7-d7b4-499f-8c41-4029a2d53f81 req-4a769076-e7e2-4c10-bc36-05a0565cfa05 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452793 Feb 17 18:10:26.635265 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0e00c03-3316-4e08-b529-001631706b56 req-89f0c1c6-1683-4e2c-8f9f-462192182092 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:26.637219 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e0e00c03-3316-4e08-b529-001631706b56 req-89f0c1c6-1683-4e2c-8f9f-462192182092 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1078937 Feb 17 18:10:26.689927 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-e0e00c03-3316-4e08-b529-001631706b56 req-c5e821e9-6888-4bc8-9e20-c66ec61e0eaa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462670 Feb 17 18:10:27.277727 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:10:27.367902 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:10:27.368499 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:27.389491 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a748bd-b067-477d-bd7d-b528a34dafbe req-c6e68eb8-fba9-4c86-8a88-6873a9dbb672 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:27.391304 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-51a748bd-b067-477d-bd7d-b528a34dafbe req-c6e68eb8-fba9-4c86-8a88-6873a9dbb672 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.1245987 Feb 17 18:10:27.456078 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-51a748bd-b067-477d-bd7d-b528a34dafbe req-48043891-4cba-45cf-af01-d4d747219838 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547206 Feb 17 18:10:27.895302 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d4dd89-fc91-44bb-a8b8-9c102f2f219e req-22e834bc-3dfc-46a8-80df-e0c914d5efae tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:27.896906 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d8d4dd89-fc91-44bb-a8b8-9c102f2f219e req-22e834bc-3dfc-46a8-80df-e0c914d5efae tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0849743 Feb 17 18:10:27.943430 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d8d4dd89-fc91-44bb-a8b8-9c102f2f219e req-3a5ee199-4d24-48ad-a8b4-ed7fef57cb2d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403063 Feb 17 18:10:28.657178 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57643cca-9f38-44f4-b924-f8453adf192a req-1ebf3baf-d708-4053-b66e-a04cd98efcec tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:28.659439 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-57643cca-9f38-44f4-b924-f8453adf192a req-1ebf3baf-d708-4053-b66e-a04cd98efcec tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0898039 Feb 17 18:10:28.706631 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-57643cca-9f38-44f4-b924-f8453adf192a req-88178862-0f47-4113-b550-b5e375a5022e tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408740 Feb 17 18:10:29.439762 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aed4654-af70-40c4-b159-d837f123224a req-884c1953-2492-4aa1-9ab2-e11145586bee tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:29.441402 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2aed4654-af70-40c4-b159-d837f123224a req-884c1953-2492-4aa1-9ab2-e11145586bee tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.70 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.0867913 Feb 17 18:10:29.723843 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-2aed4654-af70-40c4-b159-d837f123224a req-8c5e1ba8-44f9-439c-ad87-b404e04579f4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Deleting port c3de3799-da31-433f-9203-bfbce68f8d59 {{(pid=84111) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:10:29.724462 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-2aed4654-af70-40c4-b159-d837f123224a req-8c5e1ba8-44f9-439c-ad87-b404e04579f4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:30.026794 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf189837-10af-4756-aa19-59b2e1d85ab8 req-71fc0033-8961-4112-9ef0-0b73f946eecd tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:30.028397 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf189837-10af-4756-aa19-59b2e1d85ab8 req-71fc0033-8961-4112-9ef0-0b73f946eecd tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 945 time: 0.2004652 Feb 17 18:10:30.073197 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-2aed4654-af70-40c4-b159-d837f123224a req-8c5e1ba8-44f9-439c-ad87-b404e04579f4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] For port c3de3799-da31-433f-9203-bfbce68f8d59, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=c3de3799-da31-433f-9203-bfbce68f8d59,segment=NetworkSegment(eaf585ce-3bb4-4c27-942c-8aa396958840),segment_id=eaf585ce-3bb4-4c27-942c-8aa396958840)] {{(pid=84111) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:10:30.073590 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-2aed4654-af70-40c4-b159-d837f123224a req-8c5e1ba8-44f9-439c-ad87-b404e04579f4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:30.119044 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:10:30.216964 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-2aed4654-af70-40c4-b159-d837f123224a req-8c5e1ba8-44f9-439c-ad87-b404e04579f4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Calling delete_port for c3de3799-da31-433f-9203-bfbce68f8d59 owned by compute:nova {{(pid=84111) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:10:30.265970 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf189837-10af-4756-aa19-59b2e1d85ab8 req-28190ff3-4fb3-4ac6-a9a6-777c67e8c826 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/security-groups?id=2a4b39df-00a5-4eff-9100-12943c73c018&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2311640 Feb 17 18:10:30.435176 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-2aed4654-af70-40c4-b159-d837f123224a req-8c5e1ba8-44f9-439c-ad87-b404e04579f4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:30.453272 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-00ec6f52-2af6-4775-a665-b10ed59ff729 tempest-AttachVolumeNegativeTest-1414743409 tempest-AttachVolumeNegativeTest-1414743409-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:30.553384 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c5e1ba8-44f9-439c-ad87-b404e04579f4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Pushing event deleted for resources: {'Port': ['ID=c3de3799-da31-433f-9203-bfbce68f8d59,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:30.556126 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-8c5e1ba8-44f9-439c-ad87-b404e04579f4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:30.575848 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 58708) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:30.672760 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-2aed4654-af70-40c4-b159-d837f123224a req-8c5e1ba8-44f9-439c-ad87-b404e04579f4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] No DVR routers for this DVR port c3de3799-da31-433f-9203-bfbce68f8d59 on host hv-cinder-76019 {{(pid=84111) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Feb 17 18:10:30.675854 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-2aed4654-af70-40c4-b159-d837f123224a req-8c5e1ba8-44f9-439c-ad87-b404e04579f4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:30.678772 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a3149cc7-0c1b-4a08-848e-c50667987d6b', 'name': 'network-vif-deleted', 'tag': 'c3de3799-da31-433f-9203-bfbce68f8d59'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:10:30.692365 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2aed4654-af70-40c4-b159-d837f123224a req-8c5e1ba8-44f9-439c-ad87-b404e04579f4 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.70 "DELETE /v2.0/ports/c3de3799-da31-433f-9203-bfbce68f8d59 HTTP/1.1" status: 204 len: 173 time: 1.2451837 Feb 17 18:10:30.705145 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f33958d5-925e-4e22-af7f-b9a12476b495 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:30.721638 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f33958d5-925e-4e22-af7f-b9a12476b495 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:10:30.725811 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f33958d5-925e-4e22-af7f-b9a12476b495 admin admin] Usage tracker for resource:security_group_rule and tenant:73c2d5dec5654817979c6f28e74a225e is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:10:30.729272 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f33958d5-925e-4e22-af7f-b9a12476b495 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:10:30.729634 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a3149cc7-0c1b-4a08-848e-c50667987d6b', 'name': 'network-vif-deleted', 'tag': 'c3de3799-da31-433f-9203-bfbce68f8d59', 'status': 'completed', 'code': 200} Feb 17 18:10:30.735411 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f33958d5-925e-4e22-af7f-b9a12476b495 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:10:30.825232 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f33958d5-925e-4e22-af7f-b9a12476b495 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:30.880625 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f33958d5-925e-4e22-af7f-b9a12476b495 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:30.890102 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ce11e85a-9628-457e-9d95-406e49f7356f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:30.933994 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f33958d5-925e-4e22-af7f-b9a12476b495 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=73c2d5dec5654817979c6f28e74a225e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3567829 Feb 17 18:10:30.935687 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f33958d5-925e-4e22-af7f-b9a12476b495 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3baa02a4-a818-434e-9571-3a39555a9fe2,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:30.936940 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 58716) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:30.939088 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f33958d5-925e-4e22-af7f-b9a12476b495 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:30.998845 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-34af6c65-acc0-4678-bbeb-523614ad62a5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:31.028891 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-34af6c65-acc0-4678-bbeb-523614ad62a5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:31.098088 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-34af6c65-acc0-4678-bbeb-523614ad62a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:31.102868 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ead0fb09-f252-4bcc-94a1-ea2c07236e48 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:31.116054 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34af6c65-acc0-4678-bbeb-523614ad62a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3baa02a4-a818-434e-9571-3a39555a9fe2,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:31.119049 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-34af6c65-acc0-4678-bbeb-523614ad62a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:31.119973 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-34af6c65-acc0-4678-bbeb-523614ad62a5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:31.121169 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-34af6c65-acc0-4678-bbeb-523614ad62a5 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3baa02a4-a818-434e-9571-3a39555a9fe2 HTTP/1.1" status: 204 len: 168 time: 0.1831357 Feb 17 18:10:31.260375 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 no longer exists at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:10:31.299539 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] No Port match for: c3de3799-da31-433f-9203-bfbce68f8d59 {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:10:31.299999 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device c3de3799-da31-433f-9203-bfbce68f8d59 not bound to the agent host hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:10:31.449649 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-11c3fbbe-6814-4209-99c9-bf7ff63c9635 req-5c647e5f-dd9d-4632-8216-73b1112e6538 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Synchronizing usage tracker for tenant:bda7a35e855840d7bc75e16e402f3690 on resource:port {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:10:31.497588 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-11c3fbbe-6814-4209-99c9-bf7ff63c9635 req-5c647e5f-dd9d-4632-8216-73b1112e6538 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] Unset dirty status for tenant:bda7a35e855840d7bc75e16e402f3690 on resource:port {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:10:31.498928 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-11c3fbbe-6814-4209-99c9-bf7ff63c9635 req-5c647e5f-dd9d-4632-8216-73b1112e6538 tempest-ServerRescueNegativeTestJSON-1188591618 tempest-ServerRescueNegativeTestJSON-1188591618-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3149cc7-0c1b-4a08-848e-c50667987d6b HTTP/1.1" status: 200 len: 210 time: 0.0981464 Feb 17 18:10:32.602393 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 58756) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:33.174993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal--9223372036854371425'] for router_interface, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:33.548153 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] Deleting port 780be217-eb0a-4e51-a67c-6d7f3345b156 {{(pid=84111) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:10:33.548530 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:33.737984 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] For port 780be217-eb0a-4e51-a67c-6d7f3345b156, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=780be217-eb0a-4e51-a67c-6d7f3345b156,segment=NetworkSegment(eaf585ce-3bb4-4c27-942c-8aa396958840),segment_id=eaf585ce-3bb4-4c27-942c-8aa396958840)] {{(pid=84111) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:10:33.738538 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:33.867262 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] Calling delete_port for 780be217-eb0a-4e51-a67c-6d7f3345b156 owned by network:router_interface {{(pid=84111) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:10:34.194326 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:34.208960 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0406c93e-af50-4dab-8277-879ffe5b0b01 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:34.522175 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] Pushing event deleted for resources: {'Port': ['ID=780be217-eb0a-4e51-a67c-6d7f3345b156,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:34.532013 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.323s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:34.848484 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c469a4c-cd42-43db-99ef-e88f28c4da4a req-c5219b34-dd42-4319-88e5-92efbeb952b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:34.850112 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7c469a4c-cd42-43db-99ef-e88f28c4da4a req-c5219b34-dd42-4319-88e5-92efbeb952b3 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=5729c656e2c64606a663d6434a5c3973&device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 1202 time: 0.2815268 Feb 17 18:10:34.862945 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed671219-7fe2-4adb-8985-c2cfa293d705 req-1d7761a3-8ee3-4041-b6ab-1a054acae15d tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:34.864467 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ed671219-7fe2-4adb-8985-c2cfa293d705 req-1d7761a3-8ee3-4041-b6ab-1a054acae15d tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.2971725 Feb 17 18:10:35.120757 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ed671219-7fe2-4adb-8985-c2cfa293d705 req-e510b5b8-1611-4d76-9adc-0f142a33b453 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.1928351 Feb 17 18:10:35.152340 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c469a4c-cd42-43db-99ef-e88f28c4da4a req-151d65f4-aff3-4589-b295-ca54389debb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:35.153654 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7c469a4c-cd42-43db-99ef-e88f28c4da4a req-151d65f4-aff3-4589-b295-ca54389debb3 service neutron] 10.222.0.70 "GET /v2.0/networks?id=6755b14b-f6f6-43aa-a697-3921175c5230 HTTP/1.1" status: 200 len: 909 time: 0.2882524 Feb 17 18:10:35.157960 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1687174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal--9223372036854371343'] for router_interface, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:35.353520 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7c469a4c-cd42-43db-99ef-e88f28c4da4a req-e7d976f9-918d-494f-b3ae-0a65ebe47e9e service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 1001 time: 0.1761601 Feb 17 18:10:35.451373 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c469a4c-cd42-43db-99ef-e88f28c4da4a req-2a0992df-b04f-4c81-8d5d-7e31b3c3419b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:35.452952 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7c469a4c-cd42-43db-99ef-e88f28c4da4a req-2a0992df-b04f-4c81-8d5d-7e31b3c3419b service neutron] 10.222.0.70 "GET /v2.0/subnets?id=8a96f440-286f-407f-9d7e-b3b2727a69a9 HTTP/1.1" status: 200 len: 854 time: 0.0890076 Feb 17 18:10:35.697148 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c469a4c-cd42-43db-99ef-e88f28c4da4a req-4d808e01-ab09-4a6e-a541-fc206537c27d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:35.698730 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7c469a4c-cd42-43db-99ef-e88f28c4da4a req-4d808e01-ab09-4a6e-a541-fc206537c27d service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=6755b14b-f6f6-43aa-a697-3921175c5230&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1935632 Feb 17 18:10:36.009709 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7c469a4c-cd42-43db-99ef-e88f28c4da4a req-25a0352d-f7d9-47d4-9f70-4cc93a98689c service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2544556 Feb 17 18:10:36.014297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] Router 753da3f7-eb03-4d22-b4aa-61cd56b0892f has already been hosted by L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b {{(pid=84111) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:130}} Feb 17 18:10:36.605798 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7c469a4c-cd42-43db-99ef-e88f28c4da4a req-005c32e5-3a4d-4408-9690-0eca2a0be826 service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.5878887 Feb 17 18:10:36.629769 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84111) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:10:36.638916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9dc8cfa-8e7a-46b7-a0b4-aef513fe1086 None None] Sync routers for ids ['753da3f7-eb03-4d22-b4aa-61cd56b0892f'] in dv-cinder-760194-3-iscsi {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:10:36.641162 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9bb87c2-7282-4dee-a9cb-795fb473b088 req-9124e00c-6689-4381-882a-b2326dd64e6d tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:36.643181 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b9bb87c2-7282-4dee-a9cb-795fb473b088 req-9124e00c-6689-4381-882a-b2326dd64e6d tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.2576859 Feb 17 18:10:36.651836 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9dc8cfa-8e7a-46b7-a0b4-aef513fe1086 None None] Routers {'753da3f7-eb03-4d22-b4aa-61cd56b0892f'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:10:36.656505 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-f9dc8cfa-8e7a-46b7-a0b4-aef513fe1086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:10:10Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['753da3f7-eb03-4d22-b4aa-61cd56b0892f'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:36.697139 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b9bb87c2-7282-4dee-a9cb-795fb473b088 req-cde21f93-6d75-46f6-8aa0-0a5e6ac7db15 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0472629 Feb 17 18:10:36.706468 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] 10.222.0.13 "PUT /v2.0/routers/753da3f7-eb03-4d22-b4aa-61cd56b0892f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.1023693 Feb 17 18:10:36.709112 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 58802) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:36.846964 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-f9dc8cfa-8e7a-46b7-a0b4-aef513fe1086 None None] Set router 753da3f7-eb03-4d22-b4aa-61cd56b0892f gateway port host: dv-cinder-760194-3-iscsi {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:10:36.909020 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Notify callbacks [] for router, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:37.096417 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:37.143683 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Deleting port 70c0b2b2-f638-4813-b2dc-4e6d89d13791 {{(pid=84111) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:10:37.144035 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:37.152729 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-f9dc8cfa-8e7a-46b7-a0b4-aef513fe1086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'name': 'tempest-ServerRescueNegativeTestJSON-1294029612-router', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160'}], 'enable_snat': True}, 'gw_port_id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:43Z', 'updated_at': '2021-02-17T18:10:34Z', 'revision_number': 5, 'project_id': 'bda7a35e855840d7bc75e16e402f3690', 'gw_port': {'id': '70c0b2b2-f638-4813-b2dc-4e6d89d13791', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:ec:8a:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:46Z', 'updated_at': '2021-02-17T18:06:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi'}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:37.156785 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9dc8cfa-8e7a-46b7-a0b4-aef513fe1086 None None] Checking router: 753da3f7-eb03-4d22-b4aa-61cd56b0892f for host: dv-cinder-760194-3-iscsi {{(pid=84114) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:10:37.166206 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9dc8cfa-8e7a-46b7-a0b4-aef513fe1086 None None] Routers {'753da3f7-eb03-4d22-b4aa-61cd56b0892f'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84114) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:10:37.166852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-f9dc8cfa-8e7a-46b7-a0b4-aef513fe1086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:10:10Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['753da3f7-eb03-4d22-b4aa-61cd56b0892f'], 'active': True} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:37.326592 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-f9dc8cfa-8e7a-46b7-a0b4-aef513fe1086 None None] Set router 753da3f7-eb03-4d22-b4aa-61cd56b0892f gateway port host: None {{(pid=84114) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:10:37.334024 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] For port 70c0b2b2-f638-4813-b2dc-4e6d89d13791, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=70c0b2b2-f638-4813-b2dc-4e6d89d13791,segment=NetworkSegment(b5e97d06-6722-4de8-9658-658adc74c7b4),segment_id=b5e97d06-6722-4de8-9658-658adc74c7b4)] {{(pid=84111) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:10:37.334430 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:37.440602 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-f9dc8cfa-8e7a-46b7-a0b4-aef513fe1086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'name': 'tempest-ServerRescueNegativeTestJSON-1294029612-router', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:43Z', 'updated_at': '2021-02-17T18:10:37Z', 'revision_number': 6, 'project_id': 'bda7a35e855840d7bc75e16e402f3690', 'gw_port_host': None}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84114) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:37.444698 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9dc8cfa-8e7a-46b7-a0b4-aef513fe1086 None None] The sync data for ids ['753da3f7-eb03-4d22-b4aa-61cd56b0892f'] in dv-cinder-760194-3-iscsi is: [{'id': '753da3f7-eb03-4d22-b4aa-61cd56b0892f', 'name': 'tempest-ServerRescueNegativeTestJSON-1294029612-router', 'tenant_id': 'bda7a35e855840d7bc75e16e402f3690', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:43Z', 'updated_at': '2021-02-17T18:10:37Z', 'revision_number': 6, 'project_id': 'bda7a35e855840d7bc75e16e402f3690', 'gw_port_host': None}] {{(pid=84114) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:10:37.467639 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Calling delete_port for 70c0b2b2-f638-4813-b2dc-4e6d89d13791 owned by network:router_gateway {{(pid=84111) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:10:37.669744 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ec19ca13-19a9-4ea0-b9cc-8289914d92f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:37.708834 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:37.724986 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:37.822174 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Pushing event deleted for resources: {'Port': ['ID=70c0b2b2-f638-4813-b2dc-4e6d89d13791,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:37.832258 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:37.971152 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932e7e72-fd87-4617-8c4d-77bad01b11e4 req-af660ba5-b008-4385-9074-2f00fe750872 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:37.972800 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-932e7e72-fd87-4617-8c4d-77bad01b11e4 req-af660ba5-b008-4385-9074-2f00fe750872 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.1395881 Feb 17 18:10:38.060145 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-456325'] for router_gateway, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:38.116215 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-932e7e72-fd87-4617-8c4d-77bad01b11e4 req-c4ff86f1-1283-4e35-9ab4-f3e54ccbd25e tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.1134925 Feb 17 18:10:38.250944 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id--9223372036854372299', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-5275'] for router, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:38.253286 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:38.582680 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network--9223372036854372073'] for router, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:38.583180 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 753da3f7-eb03-4d22-b4aa-61cd56b0892f {{(pid=84111) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Feb 17 18:10:38.597590 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] Notify callbacks [] for router, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:38.598801 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-bae40166-c70e-47fa-8ed8-70ea6bf327c1 admin admin] 10.222.0.13 "DELETE /v2.0/routers/753da3f7-eb03-4d22-b4aa-61cd56b0892f HTTP/1.1" status: 204 len: 168 time: 1.8878653 Feb 17 18:10:38.601527 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 58812) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:38.666991 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_v2 [None req-b88b508f-c311-4961-afa6-ecd677b33ea4 admin admin] Deleting subnet c04f01da-1295-4b8a-95ae-46589cb07040 {{(pid=84111) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1041}} Feb 17 18:10:38.670389 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b88b508f-c311-4961-afa6-ecd677b33ea4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:38.726907 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b88b508f-c311-4961-afa6-ecd677b33ea4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete--9223372036852434851'] for subnet, precommit_delete_associations {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:38.733504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 70c0b2b2-f638-4813-b2dc-4e6d89d13791 no longer exists at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:10:38.772521 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] No Port match for: 70c0b2b2-f638-4813-b2dc-4e6d89d13791 {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:10:38.772917 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 70c0b2b2-f638-4813-b2dc-4e6d89d13791 not bound to the agent host dv-cinder-760194-3-iscsi {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:10:38.773380 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 780be217-eb0a-4e51-a67c-6d7f3345b156 no longer exists at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:10:38.785222 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b88b508f-c311-4961-afa6-ecd677b33ea4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1550982'] for subnet, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:38.808485 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] No Port match for: 780be217-eb0a-4e51-a67c-6d7f3345b156 {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:10:38.808875 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device 780be217-eb0a-4e51-a67c-6d7f3345b156 not bound to the agent host dv-cinder-760194-3-iscsi {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:10:39.075178 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b88b508f-c311-4961-afa6-ecd677b33ea4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler--9223372036853224802', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event--9223372036853148456', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted--9223372036850649176', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9686835'] for subnet, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:39.091168 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:39.178993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88b508f-c311-4961-afa6-ecd677b33ea4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c04f01da-1295-4b8a-95ae-46589cb07040,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:39.183573 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b88b508f-c311-4961-afa6-ecd677b33ea4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:39.513288 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b88b508f-c311-4961-afa6-ecd677b33ea4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:39.523151 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-b88b508f-c311-4961-afa6-ecd677b33ea4 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/c04f01da-1295-4b8a-95ae-46589cb07040 HTTP/1.1" status: 204 len: 168 time: 0.9206202 Feb 17 18:10:39.526059 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 58820) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:39.538159 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2275044-7cc0-4180-902c-301b465c09a3 req-329400c1-636c-491e-a009-929d2c5d9224 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:39.539720 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d2275044-7cc0-4180-902c-301b465c09a3 req-329400c1-636c-491e-a009-929d2c5d9224 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.1165471 Feb 17 18:10:39.591009 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d2275044-7cc0-4180-902c-301b465c09a3 req-7fffabbf-fb0f-4562-af9c-53260c93e6dc tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0446959 Feb 17 18:10:39.644440 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1376323'] for network, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:39.823562 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e655b3a6-6207-4f78-8f42-03a79a11c1b6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:39.836487 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1551647', 'neutron.services.segments.db._delete_segments_for_network-8730056716045'] for network, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:39.949480 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4aaf4a03-4480-421f-bff4-f9814e969001']}} {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:39.962095 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'eaf585ce-3bb4-4c27-942c-8aa396958840') {'for_net_delete': True} {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:39.962429 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.services.segments.db [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'eaf585ce-3bb4-4c27-942c-8aa396958840') {} {{(pid=84112) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:10:39.975019 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8730056711181', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2158030'] for segment, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:39.989986 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change--9223372036853228625'] for segment, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:39.992056 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.type_tunnel [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] Releasing vxlan tunnel 3 to pool {{(pid=84112) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:322}} Feb 17 18:10:40.167618 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] Network 4aaf4a03-4480-421f-bff4-f9814e969001 has no segments {{(pid=84112) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:10:40.176549 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1547159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2235342'] for segment, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:40.353397 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] Network 4aaf4a03-4480-421f-bff4-f9814e969001 has no segments {{(pid=84112) _extend_network_dict_provider /opt/stack/neutron/neutron/plugins/ml2/managers.py:169}} Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: Traceback (most recent call last): Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: timer() Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: cb(*args, **kw) Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/common/utils.py", line 973, in wrapper Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: return func(*args, **kwargs) Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: self._notify() Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: self.callback(batched_events) Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: event.method(event) Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 367, in _get_aggregate_id Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: segment_id)['aggregates'][0] Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: return f(self, *a, **k) Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: return self._get(url).json() Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: **kwargs) Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1131, in get Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: return self.request(url, 'GET', **kwargs) Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 802, in request Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: **endpoint_filter) Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: File "/usr/local/lib/python3.6/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 17 18:10:40.375381 dv-cinder-760194-3-iscsi neutron-server[84000]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 17 18:10:40.486901 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler--9223372036853224169', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629463', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net--9223372036854319422'] for network, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:40.490398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-cb77c3ca-7687-4d7a-847a-0feaff4a9a54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:40.507117 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification--9223372036853088612'] for network, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:40.513323 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] Pushing event deleted for resources: {'Network': ['ID=4aaf4a03-4480-421f-bff4-f9814e969001,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:40.518151 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:40.550378 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-37aa3eeb-d4d3-4599-821f-4a00f92075b9 admin admin] 10.222.0.13 "DELETE /v2.0/networks/4aaf4a03-4480-421f-bff4-f9814e969001 HTTP/1.1" status: 204 len: 168 time: 1.0231068 Feb 17 18:10:40.795432 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d202e0d-1efc-4d93-9b6c-d2c20c631185 req-72563788-ca72-4732-a8cf-104bc5ca58c7 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:40.797385 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4d202e0d-1efc-4d93-9b6c-d2c20c631185 req-72563788-ca72-4732-a8cf-104bc5ca58c7 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.0906012 Feb 17 18:10:40.834218 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:40.835199 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 58830) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:40.850674 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4d202e0d-1efc-4d93-9b6c-d2c20c631185 req-2472ad2a-4279-4de7-a558-fd0a677bc238 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0463452 Feb 17 18:10:40.887642 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e3a7a39d-fd53-4fe1-ad6c-7493e1bc0fc6 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=bda7a35e855840d7bc75e16e402f3690&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0510211 Feb 17 18:10:40.890365 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 58834) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:40.951777 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3928f85c-d8ba-4570-b5fe-0abff1bbdc33 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:40.979351 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3928f85c-d8ba-4570-b5fe-0abff1bbdc33 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:41.063548 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3928f85c-d8ba-4570-b5fe-0abff1bbdc33 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:41.069274 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e077dfbf-c3a6-43d7-b554-8069b07cbac9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:41.084091 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3928f85c-d8ba-4570-b5fe-0abff1bbdc33 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a4b39df-00a5-4eff-9100-12943c73c018,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:41.086624 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3928f85c-d8ba-4570-b5fe-0abff1bbdc33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:41.119136 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3928f85c-d8ba-4570-b5fe-0abff1bbdc33 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:41.120406 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3928f85c-d8ba-4570-b5fe-0abff1bbdc33 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2a4b39df-00a5-4eff-9100-12943c73c018 HTTP/1.1" status: 204 len: 168 time: 0.2290554 Feb 17 18:10:42.007244 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:42.076137 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c7557fa-c424-46f2-aaf1-c921d7983e4e req-5293b2a1-7e31-4ee7-891a-6814f255dbcb tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:42.078098 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2c7557fa-c424-46f2-aaf1-c921d7983e4e req-5293b2a1-7e31-4ee7-891a-6814f255dbcb tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.1072211 Feb 17 18:10:42.138117 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2c7557fa-c424-46f2-aaf1-c921d7983e4e req-25ea5ec0-2aee-4b8f-98e0-d00d9e0eae33 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0516655 Feb 17 18:10:42.749585 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:43.431332 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 58906) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:43.555955 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb5d894-2656-40de-9b60-ef5d86c8513e req-a099c3fa-064f-4ac8-aeee-253f2edd6d7f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:43.557809 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-afb5d894-2656-40de-9b60-ef5d86c8513e req-a099c3fa-064f-4ac8-aeee-253f2edd6d7f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.1599376 Feb 17 18:10:43.578708 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-16f3d4ab-175d-4a47-bedc-f5b2de7464cd admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:43.584007 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7ce50b51-f2ce-4789-ac44-7c78e9e0c903 req-a52bf5fb-9e87-42a2-923d-12688e35ad9e service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 272 time: 0.1085908 Feb 17 18:10:43.597425 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-16f3d4ab-175d-4a47-bedc-f5b2de7464cd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:10:43.602071 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-16f3d4ab-175d-4a47-bedc-f5b2de7464cd admin admin] Usage tracker for resource:security_group_rule and tenant:17abbf4012414420a3e25c9ece46260a is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:10:43.605400 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-16f3d4ab-175d-4a47-bedc-f5b2de7464cd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:10:43.611477 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-16f3d4ab-175d-4a47-bedc-f5b2de7464cd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:10:43.651593 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-afb5d894-2656-40de-9b60-ef5d86c8513e req-95681c71-7fbd-4771-9fdf-38113bbc9516 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0641837 Feb 17 18:10:43.712162 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-16f3d4ab-175d-4a47-bedc-f5b2de7464cd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:43.745621 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce50b51-f2ce-4789-ac44-7c78e9e0c903 req-f8b9f6fe-f76a-4592-af33-24258f7cda5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:43.747340 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7ce50b51-f2ce-4789-ac44-7c78e9e0c903 req-f8b9f6fe-f76a-4592-af33-24258f7cda5d service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 1162 time: 0.0858560 Feb 17 18:10:43.748472 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-16f3d4ab-175d-4a47-bedc-f5b2de7464cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:43.758149 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6034854d-a0cb-4645-8244-71d9918a10a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:43.801449 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-16f3d4ab-175d-4a47-bedc-f5b2de7464cd admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=17abbf4012414420a3e25c9ece46260a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3687778 Feb 17 18:10:43.803112 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16f3d4ab-175d-4a47-bedc-f5b2de7464cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8780aa4e-5759-42ad-ae24-bf4f36bb3ad8,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:43.805675 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 58920) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:43.808638 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-16f3d4ab-175d-4a47-bedc-f5b2de7464cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:43.874465 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d05f0478-2027-4aec-b25c-512fef64674d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:43.921475 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce50b51-f2ce-4789-ac44-7c78e9e0c903 req-ca0583d4-c29d-43bc-82bb-c8f8b94d01eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:43.923245 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7ce50b51-f2ce-4789-ac44-7c78e9e0c903 req-ca0583d4-c29d-43bc-82bb-c8f8b94d01eb service neutron] 10.222.0.70 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 907 time: 0.1567268 Feb 17 18:10:44.043721 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7ce50b51-f2ce-4789-ac44-7c78e9e0c903 req-72b4b33a-7a4a-40cd-bf17-459d69569227 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 HTTP/1.1" status: 200 len: 1000 time: 0.1129377 Feb 17 18:10:44.107065 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d05f0478-2027-4aec-b25c-512fef64674d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:44.119925 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce50b51-f2ce-4789-ac44-7c78e9e0c903 req-012d8f01-5039-4507-9c86-7e7cd295d02f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:44.121531 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7ce50b51-f2ce-4789-ac44-7c78e9e0c903 req-012d8f01-5039-4507-9c86-7e7cd295d02f service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2f43211a-7773-487d-8b86-a136c7f7c156 HTTP/1.1" status: 200 len: 852 time: 0.0703037 Feb 17 18:10:44.201096 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d05f0478-2027-4aec-b25c-512fef64674d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:44.204617 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce50b51-f2ce-4789-ac44-7c78e9e0c903 req-4b436704-3799-42ba-a799-3692e0fd9c41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:44.206286 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7ce50b51-f2ce-4789-ac44-7c78e9e0c903 req-4b436704-3799-42ba-a799-3692e0fd9c41 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0781589 Feb 17 18:10:44.206450 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b969f172-5ea5-4c55-bda5-976525adb41a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:44.219116 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d05f0478-2027-4aec-b25c-512fef64674d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8780aa4e-5759-42ad-ae24-bf4f36bb3ad8,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:44.222326 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d05f0478-2027-4aec-b25c-512fef64674d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:44.230265 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d05f0478-2027-4aec-b25c-512fef64674d admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:44.230265 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-d05f0478-2027-4aec-b25c-512fef64674d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8780aa4e-5759-42ad-ae24-bf4f36bb3ad8 HTTP/1.1" status: 204 len: 168 time: 0.4192426 Feb 17 18:10:44.358385 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7ce50b51-f2ce-4789-ac44-7c78e9e0c903 req-d047bcb6-081c-4ba1-a657-d289fd8f96a9 service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1387880 Feb 17 18:10:44.510132 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-7ce50b51-f2ce-4789-ac44-7c78e9e0c903 req-fba9afdb-dcc4-42dc-bb14-021a69cd0bda service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1411412 Feb 17 18:10:44.799577 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 58934) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:44.818852 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1be43624-ef68-448c-bd9f-24050ccb1e5b admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:44.834010 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-1be43624-ef68-448c-bd9f-24050ccb1e5b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:10:44.838215 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-1be43624-ef68-448c-bd9f-24050ccb1e5b admin admin] Usage tracker for resource:security_group_rule and tenant:644ac3a49a4f4908930916a44c757b90 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:10:44.841541 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-1be43624-ef68-448c-bd9f-24050ccb1e5b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:10:44.847971 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-1be43624-ef68-448c-bd9f-24050ccb1e5b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:10:44.850247 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dda1b95-4e3d-4234-aff4-fc634255a048 req-85b7e961-ef33-4e2a-93eb-34cae1e60f2e tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:44.851845 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4dda1b95-4e3d-4234-aff4-fc634255a048 req-85b7e961-ef33-4e2a-93eb-34cae1e60f2e tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.0858877 Feb 17 18:10:44.904737 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4dda1b95-4e3d-4234-aff4-fc634255a048 req-4340b6cb-6447-4512-8aec-d3a1557622a3 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0460985 Feb 17 18:10:44.934756 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1be43624-ef68-448c-bd9f-24050ccb1e5b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:44.966095 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1be43624-ef68-448c-bd9f-24050ccb1e5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:44.974927 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-267b3200-9a60-46aa-a504-11b3752d9652 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:45.016325 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-1be43624-ef68-448c-bd9f-24050ccb1e5b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=644ac3a49a4f4908930916a44c757b90&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2154992 Feb 17 18:10:45.017758 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1be43624-ef68-448c-bd9f-24050ccb1e5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c24057b-bf46-43a9-9d7f-16f9f87295f4,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:45.019715 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 58940) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:45.021024 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1be43624-ef68-448c-bd9f-24050ccb1e5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:45.084567 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c9a5ffa6-6ec5-4287-a832-11e745ee28ee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:45.112224 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c9a5ffa6-6ec5-4287-a832-11e745ee28ee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:45.183498 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c9a5ffa6-6ec5-4287-a832-11e745ee28ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:45.188538 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0358c0ae-aa79-4c89-ba2e-1e0be5ad6879 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:45.202512 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9a5ffa6-6ec5-4287-a832-11e745ee28ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c24057b-bf46-43a9-9d7f-16f9f87295f4,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:45.206059 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c9a5ffa6-6ec5-4287-a832-11e745ee28ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:45.208083 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c9a5ffa6-6ec5-4287-a832-11e745ee28ee admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:45.212936 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-c9a5ffa6-6ec5-4287-a832-11e745ee28ee admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3c24057b-bf46-43a9-9d7f-16f9f87295f4 HTTP/1.1" status: 204 len: 168 time: 0.1889057 Feb 17 18:10:46.108945 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ab5d784-3f64-412c-9e4e-aac7e01c304e req-3edac14f-0f21-417f-9a05-4cc0e7a88f8c tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:46.110648 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6ab5d784-3f64-412c-9e4e-aac7e01c304e req-3edac14f-0f21-417f-9a05-4cc0e7a88f8c tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.0912945 Feb 17 18:10:46.160685 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6ab5d784-3f64-412c-9e4e-aac7e01c304e req-ae3b7050-52a3-44a9-bd51-0f1e84f1a0e5 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0434854 Feb 17 18:10:47.362873 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c4f45d4-f79d-4b46-903f-a62fce3e8295 req-09615b70-229a-408c-afa1-a663191fa2c9 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:47.364670 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1c4f45d4-f79d-4b46-903f-a62fce3e8295 req-09615b70-229a-408c-afa1-a663191fa2c9 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.0882502 Feb 17 18:10:47.414507 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1c4f45d4-f79d-4b46-903f-a62fce3e8295 req-cda9ad27-8809-4423-8cee-28031bb599a6 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0432465 Feb 17 18:10:47.738228 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:48.640344 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee419362-5509-4fb1-9327-4fa0ae30af3c req-d9ae73ad-1fde-47c1-8cb4-378647f526ef tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:48.641934 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ee419362-5509-4fb1-9327-4fa0ae30af3c req-d9ae73ad-1fde-47c1-8cb4-378647f526ef tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.0911176 Feb 17 18:10:48.691927 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ee419362-5509-4fb1-9327-4fa0ae30af3c req-3f3bd157-2976-4ffe-82b3-13933e455f2c tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0430963 Feb 17 18:10:49.899698 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-051d40fa-e427-4a8b-bfbd-400507440d63 req-378a54a3-d5c3-4d95-9028-ee5bed02deb1 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:49.901367 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-051d40fa-e427-4a8b-bfbd-400507440d63 req-378a54a3-d5c3-4d95-9028-ee5bed02deb1 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.0919344 Feb 17 18:10:49.953636 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-051d40fa-e427-4a8b-bfbd-400507440d63 req-e57e3551-564f-416d-bb4b-cb753154376d tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0457418 Feb 17 18:10:50.083997 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e5b8b8b3-6466-4164-8a2d-7627684ce9d0 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:10:50.159975 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:10:50.160398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:51.168574 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a40a61-c740-4cae-aeff-f6827fc59c65 req-2fa2294e-669f-4d04-a336-9a68c7563df9 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:51.170182 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d9a40a61-c740-4cae-aeff-f6827fc59c65 req-2fa2294e-669f-4d04-a336-9a68c7563df9 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.0866678 Feb 17 18:10:51.221302 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d9a40a61-c740-4cae-aeff-f6827fc59c65 req-36778bab-4dd5-4186-ab0e-abc2e46da4cc tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0448012 Feb 17 18:10:52.422717 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40afbff-e901-4c9f-826e-adb99de81746 req-d7342e70-76af-4501-a09b-c5a6fafed909 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:52.424934 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c40afbff-e901-4c9f-826e-adb99de81746 req-d7342e70-76af-4501-a09b-c5a6fafed909 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.0894547 Feb 17 18:10:52.476674 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c40afbff-e901-4c9f-826e-adb99de81746 req-2277ad55-fb38-4fe1-a571-30e11c1e226f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0451365 Feb 17 18:10:53.683801 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-407cf331-bb3d-4d1e-ba12-086e4cfe4f85 req-5e5a814b-beaa-4884-8fc1-ee9c606508da tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:10:53.685414 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-407cf331-bb3d-4d1e-ba12-086e4cfe4f85 req-5e5a814b-beaa-4884-8fc1-ee9c606508da tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.0894134 Feb 17 18:10:53.735741 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-407cf331-bb3d-4d1e-ba12-086e4cfe4f85 req-83320142-6aaa-476a-8e63-96497c1f7b11 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&id=72d18d1b-1457-452a-9e65-49d155c0fafe&fields=id&fields=name HTTP/1.1" status: 200 len: 389 time: 0.0432708 Feb 17 18:10:54.103374 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e5b8b8b3-6466-4164-8a2d-7627684ce9d0 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:10:54.174801 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:10:54.175224 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:58.799272 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 59174) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:58.925306 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:58.941735 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:10:58.945786 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Usage tracker for resource:security_group_rule and tenant:bd699a7f770545f499ae45b64912ae23 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:10:58.948737 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:10:58.954515 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:10:59.038151 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:59.068871 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:59.077808 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-c8b9ee69-a854-4737-bda2-73def674c993 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:59.118892 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=bd699a7f770545f499ae45b64912ae23&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3179123 Feb 17 18:10:59.120592 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b044c2a-1f02-405d-95f1-4b3ee0b67d7d,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:59.121858 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 59180) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:59.129214 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.129631 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.130035 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.130438 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.130833 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.131232 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.131623 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.132040 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.132431 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.132821 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.133208 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.133593 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.134018 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.134406 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.134792 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.135180 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.135561 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.135975 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.136365 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.136751 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.137135 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.137517 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.138012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.138261 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84111) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:10:59.142771 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-0e005b4d-9592-4d95-a150-2709d5831dde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:59.191061 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7bab1680-c9a4-4861-958d-e5beb801c161 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:59.218983 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7bab1680-c9a4-4861-958d-e5beb801c161 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:59.285911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7bab1680-c9a4-4861-958d-e5beb801c161 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:59.291474 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-fc732e06-0dc4-4b92-a316-87367a1162ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:59.304532 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bab1680-c9a4-4861-958d-e5beb801c161 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b044c2a-1f02-405d-95f1-4b3ee0b67d7d,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:59.307005 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7bab1680-c9a4-4861-958d-e5beb801c161 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:59.314825 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7bab1680-c9a4-4861-958d-e5beb801c161 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:59.316145 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-7bab1680-c9a4-4861-958d-e5beb801c161 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7b044c2a-1f02-405d-95f1-4b3ee0b67d7d HTTP/1.1" status: 204 len: 168 time: 0.1931803 Feb 17 18:10:59.700644 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 59190) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:59.720193 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-63f8f379-6313-4dcb-89da-fa07f97ac775 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:59.735785 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-63f8f379-6313-4dcb-89da-fa07f97ac775 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:10:59.739826 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-63f8f379-6313-4dcb-89da-fa07f97ac775 admin admin] Usage tracker for resource:security_group_rule and tenant:0acfdf8e4b1c445c9aa8b4f71f2933ab is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:10:59.742813 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-63f8f379-6313-4dcb-89da-fa07f97ac775 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:10:59.748562 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-63f8f379-6313-4dcb-89da-fa07f97ac775 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:10:59.831425 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-63f8f379-6313-4dcb-89da-fa07f97ac775 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:59.857439 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-63f8f379-6313-4dcb-89da-fa07f97ac775 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:10:59.866986 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3928f85c-d8ba-4570-b5fe-0abff1bbdc33 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:10:59.911379 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-63f8f379-6313-4dcb-89da-fa07f97ac775 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0acfdf8e4b1c445c9aa8b4f71f2933ab&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2096264 Feb 17 18:10:59.913069 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63f8f379-6313-4dcb-89da-fa07f97ac775 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=02e763cb-0a66-411c-97b3-dfc4c7819f75,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:10:59.914349 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 59194) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:10:59.916319 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-63f8f379-6313-4dcb-89da-fa07f97ac775 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:10:59.980746 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b4c89d5f-d5bb-4815-8441-7fbee922e905 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:00.007420 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b4c89d5f-d5bb-4815-8441-7fbee922e905 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:00.074471 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b4c89d5f-d5bb-4815-8441-7fbee922e905 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:00.079350 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e791ed17-f14a-4adf-9eea-47119b04466e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:00.092051 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4c89d5f-d5bb-4815-8441-7fbee922e905 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=02e763cb-0a66-411c-97b3-dfc4c7819f75,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:00.096050 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b4c89d5f-d5bb-4815-8441-7fbee922e905 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:00.102084 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b4c89d5f-d5bb-4815-8441-7fbee922e905 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:00.103293 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-b4c89d5f-d5bb-4815-8441-7fbee922e905 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/02e763cb-0a66-411c-97b3-dfc4c7819f75 HTTP/1.1" status: 204 len: 168 time: 0.1878169 Feb 17 18:11:01.467828 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 59228) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:01.594243 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f09208e4-e187-410d-b078-272fa46e375e admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:01.609571 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f09208e4-e187-410d-b078-272fa46e375e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:01.615064 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f09208e4-e187-410d-b078-272fa46e375e admin admin] Usage tracker for resource:security_group_rule and tenant:2adc16cf57264030ad5b92a96ce31b80 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:01.618615 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f09208e4-e187-410d-b078-272fa46e375e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:01.624187 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f09208e4-e187-410d-b078-272fa46e375e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:01.708528 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f09208e4-e187-410d-b078-272fa46e375e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:01.736297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f09208e4-e187-410d-b078-272fa46e375e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:01.745064 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a018473c-c52d-4ce8-a03c-7b52c53713ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:01.787194 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f09208e4-e187-410d-b078-272fa46e375e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2adc16cf57264030ad5b92a96ce31b80&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3182056 Feb 17 18:11:01.788124 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f09208e4-e187-410d-b078-272fa46e375e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a2973df-888c-4494-92de-b4efbf6c5317,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:01.790143 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 59236) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:01.791377 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f09208e4-e187-410d-b078-272fa46e375e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:01.852392 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8fa1cb53-090f-47de-b1d3-acb3bd25143f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:01.880181 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8fa1cb53-090f-47de-b1d3-acb3bd25143f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:01.947673 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8fa1cb53-090f-47de-b1d3-acb3bd25143f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:01.952531 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-25765972-cb0a-4651-9000-feb0c4a5f93e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:01.967974 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fa1cb53-090f-47de-b1d3-acb3bd25143f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a2973df-888c-4494-92de-b4efbf6c5317,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:01.970996 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-8fa1cb53-090f-47de-b1d3-acb3bd25143f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:01.973013 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8fa1cb53-090f-47de-b1d3-acb3bd25143f admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:01.976648 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-8fa1cb53-090f-47de-b1d3-acb3bd25143f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5a2973df-888c-4494-92de-b4efbf6c5317 HTTP/1.1" status: 204 len: 168 time: 0.1829467 Feb 17 18:11:07.118296 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:11:07.680204 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ad5b59fc-9c8e-4ff5-aae9-4c6c3ab2f8b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:09.869310 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-de63967b-664d-41c4-b9db-458ca9780618 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:10.829140 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:12.011481 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:12.764770 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:15.150595 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e3fd58f-0e21-4101-8224-d06a43c6f80e req-a4cf612c-5046-485b-9f13-bd3e7d54bc36 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:15.152204 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8e3fd58f-0e21-4101-8224-d06a43c6f80e req-a4cf612c-5046-485b-9f13-bd3e7d54bc36 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0887601 Feb 17 18:11:15.202219 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8e3fd58f-0e21-4101-8224-d06a43c6f80e req-1f424f21-6eca-4311-84f3-755d5a26be4d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426626 Feb 17 18:11:16.425364 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8472cdde-222f-404d-8355-c3f07f3913b6 req-57e47798-ae4c-4c81-9912-7014da8a8143 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:16.426935 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8472cdde-222f-404d-8355-c3f07f3913b6 req-57e47798-ae4c-4c81-9912-7014da8a8143 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0890715 Feb 17 18:11:16.474874 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8472cdde-222f-404d-8355-c3f07f3913b6 req-0e3c34df-9c8e-4908-8ce9-614010f72bb6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416408 Feb 17 18:11:16.875961 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57467396-98a0-488a-99c4-759bb523cf91 req-a46bc89d-89c0-44d6-a701-06540ec0bc94 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:16.877538 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-57467396-98a0-488a-99c4-759bb523cf91 req-a46bc89d-89c0-44d6-a701-06540ec0bc94 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.70 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.0850911 Feb 17 18:11:16.960057 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Deleting port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 {{(pid=84111) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:11:16.960440 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:17.216588 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] For port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89,segment=NetworkSegment(a3b9a246-e8d6-47cc-bbb0-e0531b20a903),segment_id=a3b9a246-e8d6-47cc-bbb0-e0531b20a903)] {{(pid=84111) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:11:17.216904 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:17.520809 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for floatingip, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:17.521226 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036854376515'] for floatingip, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:17.521429 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.l3_db [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Floating IP 08d5d43d-cc01-43c2-86a1-6faa4c214dbe disassociated. External IP: 172.27.1.57, port: e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89. Feb 17 18:11:17.521876 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Calling delete_port for e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 owned by compute:nova {{(pid=84111) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:11:17.738210 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:17.754449 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d7b3c63-6a9a-45e9-b144-a87db67e7bc4 req-b885d1f1-f6ef-4224-bb55-0cf6fbe18339 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:17.756077 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8d7b3c63-6a9a-45e9-b144-a87db67e7bc4 req-b885d1f1-f6ef-4224-bb55-0cf6fbe18339 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 945 time: 0.1485031 Feb 17 18:11:17.798779 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:17.816460 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-6d87ecde-b5fb-4ac2-8a54-06889cd5888e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:17.914258 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-8d7b3c63-6a9a-45e9-b144-a87db67e7bc4 req-98412a44-8613-4a9d-8a55-4f5b7f4a20ec tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=9fb6e7b2-439a-4b38-9765-cc107a9dfd37&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1519148 Feb 17 18:11:17.920082 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event deleted for resources: {'Port': ['ID=e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:17.931527 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:18.420714 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 has already been hosted by L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b {{(pid=84111) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:130}} Feb 17 18:11:18.611532 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84111) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:11:18.624185 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6af7b5db-bce2-4ea6-8838-3ffca0a84084 None None] Sync routers for ids ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'] in dv-cinder-760194-3-iscsi {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:11:18.634685 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6af7b5db-bce2-4ea6-8838-3ffca0a84084 None None] Routers {'26ce0b68-6f29-498d-8e7d-e9fdae0ac663'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:11:18.635357 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-6af7b5db-bce2-4ea6-8838-3ffca0a84084 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:11:10Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:18.653945 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] No DVR routers for this DVR port e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 on host hv-cinder-76019 {{(pid=84111) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Feb 17 18:11:18.656321 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:18.659726 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'name': 'network-vif-deleted', 'tag': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:11:18.668782 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-57467396-98a0-488a-99c4-759bb523cf91 req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.70 "DELETE /v2.0/ports/e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 HTTP/1.1" status: 204 len: 173 time: 1.7848618 Feb 17 18:11:18.711310 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a6f336d2-016d-499b-807b-5e379674e7f0', 'name': 'network-vif-deleted', 'tag': 'e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89', 'status': 'completed', 'code': 200} Feb 17 18:11:18.829795 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-6af7b5db-bce2-4ea6-8838-3ffca0a84084 None None] Set router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:11:19.092297 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-938e793d-a2d9-4a1c-a8ec-ad54d87ff716 req-7ad07ba9-4940-4d23-be26-5ea6d0440129 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Synchronizing usage tracker for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:port {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:11:19.178703 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-6af7b5db-bce2-4ea6-8838-3ffca0a84084 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:07:06Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': '3837ab39-c6c1-4f34-9b6b-47c98bdea645', 'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'mac_address': 'fa:16:3e:7a:00:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_interface', 'standard_attr_id': 120, 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:07:00Z', 'updated_at': '2021-02-17T18:07:17Z', 'revision_number': 5, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'subnets': [{'id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:19.182877 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6af7b5db-bce2-4ea6-8838-3ffca0a84084 None None] Checking router: 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 for host: dv-cinder-760194-3-iscsi {{(pid=84113) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:11:19.189124 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-938e793d-a2d9-4a1c-a8ec-ad54d87ff716 req-7ad07ba9-4940-4d23-be26-5ea6d0440129 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Unset dirty status for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:port {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:11:19.191017 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-938e793d-a2d9-4a1c-a8ec-ad54d87ff716 req-7ad07ba9-4940-4d23-be26-5ea6d0440129 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 210 time: 0.1472788 Feb 17 18:11:19.196502 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6af7b5db-bce2-4ea6-8838-3ffca0a84084 None None] Routers {'26ce0b68-6f29-498d-8e7d-e9fdae0ac663'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:11:19.197158 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-6af7b5db-bce2-4ea6-8838-3ffca0a84084 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:11:10Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:19.384352 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-6af7b5db-bce2-4ea6-8838-3ffca0a84084 None None] Set router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:11:19.710457 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-6af7b5db-bce2-4ea6-8838-3ffca0a84084 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:07:06Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': '3837ab39-c6c1-4f34-9b6b-47c98bdea645', 'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'mac_address': 'fa:16:3e:7a:00:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_interface', 'standard_attr_id': 120, 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:07:00Z', 'updated_at': '2021-02-17T18:07:17Z', 'revision_number': 5, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'subnets': [{'id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:19.714768 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6af7b5db-bce2-4ea6-8838-3ffca0a84084 None None] The sync data for ids ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'] in dv-cinder-760194-3-iscsi is: [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:07:06Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': '3837ab39-c6c1-4f34-9b6b-47c98bdea645', 'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'mac_address': 'fa:16:3e:7a:00:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_interface', 'standard_attr_id': 120, 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:07:00Z', 'updated_at': '2021-02-17T18:07:17Z', 'revision_number': 5, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'subnets': [{'id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}] {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:11:20.044697 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 no longer exists at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:11:20.092548 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] No Port match for: e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:11:20.092941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e2b8c96e-2481-4dc4-aaee-edcbf7f6dd89 not bound to the agent host hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:11:20.098973 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8eab134-07a7-4ab7-bef6-e3d42ab502c8 None None] New status for floating IP 08d5d43d-cc01-43c2-86a1-6faa4c214dbe: DOWN {{(pid=84114) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:272}} Feb 17 18:11:20.399421 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9acc8440-e67d-442d-925f-566f82c302b9 req-7906732a-a54e-430f-9b9a-7ffbd8a119ff tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6f336d2-016d-499b-807b-5e379674e7f0 HTTP/1.1" status: 200 len: 210 time: 0.0523174 Feb 17 18:11:22.597036 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 59486) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:22.669146 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7b4b8215-eca5-4dba-b106-eab099eec38a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:22.698409 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7b4b8215-eca5-4dba-b106-eab099eec38a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:22.777298 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7b4b8215-eca5-4dba-b106-eab099eec38a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:22.782660 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-21e8d9f6-6521-42b2-b15c-426966387793 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:22.797731 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b4b8215-eca5-4dba-b106-eab099eec38a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9fb6e7b2-439a-4b38-9765-cc107a9dfd37,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:22.800290 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7b4b8215-eca5-4dba-b106-eab099eec38a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:22.834155 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-7b4b8215-eca5-4dba-b106-eab099eec38a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:22.835379 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-7b4b8215-eca5-4dba-b106-eab099eec38a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "DELETE /v2.0/security-groups/9fb6e7b2-439a-4b38-9765-cc107a9dfd37 HTTP/1.1" status: 204 len: 168 time: 0.2372890 Feb 17 18:11:22.838361 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 59492) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:22.855293 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.api.v2.resource [None req-6e3e28c1-9b8f-4d1a-9ae0-d4118229060b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] show failed (client error): The resource could not be found. Feb 17 18:11:22.858124 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-6e3e28c1-9b8f-4d1a-9ae0-d4118229060b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups/9fb6e7b2-439a-4b38-9765-cc107a9dfd37 HTTP/1.1" status: 404 len: 347 time: 0.0168049 Feb 17 18:11:22.860397 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 59496) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:23.025134 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-a9c32f79-f05c-43a9-b856-1de6aa1a686a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Deleting port 16675505-e920-4dc7-a789-c176aa44cd96 {{(pid=84111) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:11:23.025505 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a9c32f79-f05c-43a9-b856-1de6aa1a686a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:23.203760 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a9c32f79-f05c-43a9-b856-1de6aa1a686a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:23.204038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a9c32f79-f05c-43a9-b856-1de6aa1a686a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:23.333876 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-a9c32f79-f05c-43a9-b856-1de6aa1a686a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Calling delete_port for 16675505-e920-4dc7-a789-c176aa44cd96 owned by network:floatingip {{(pid=84111) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:11:23.514104 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a9c32f79-f05c-43a9-b856-1de6aa1a686a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:23.529348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:23.631489 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9c32f79-f05c-43a9-b856-1de6aa1a686a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event deleted for resources: {'Port': ['ID=16675505-e920-4dc7-a789-c176aa44cd96,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:23.640303 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a9c32f79-f05c-43a9-b856-1de6aa1a686a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:23.748384 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a9c32f79-f05c-43a9-b856-1de6aa1a686a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for floatingip, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:23.794059 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a9c32f79-f05c-43a9-b856-1de6aa1a686a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for floatingip, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:23.795299 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-a9c32f79-f05c-43a9-b856-1de6aa1a686a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "DELETE /v2.0/floatingips/08d5d43d-cc01-43c2-86a1-6faa4c214dbe HTTP/1.1" status: 204 len: 168 time: 0.9339855 Feb 17 18:11:24.472671 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 59508) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:24.478627 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Request body: {'security_group': {'name': 'tempest-securitygroup--465933350', 'description': 'tempest-description--30484304'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:11:24.485164 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:24.490196 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Usage tracker for resource:security_group and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:24.493333 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:24.499163 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:24.536019 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:24.561538 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:24.566229 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Usage tracker for resource:security_group_rule and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:24.569391 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:24.575364 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:24.726940 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:24.770484 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:24.776246 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-34af6c65-acc0-4678-bbeb-523614ad62a5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:24.821804 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1047b73e-d2cc-4503-a589-8a51b6bcca23,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:24.824801 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:24.856149 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:24.857706 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-77e6f6e2-3e8c-4f68-bddc-f2dae78951bd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1777 time: 0.3839624 Feb 17 18:11:24.860932 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 59528) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:24.868300 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Request body: {'security_group_rule': {'security_group_id': '1047b73e-d2cc-4503-a589-8a51b6bcca23', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:11:24.874837 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:24.879327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Usage tracker for resource:security_group_rule and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:24.883477 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:24.889813 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:24.933323 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group_rule, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:24.997863 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:25.050756 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629551'] for security_group_rule, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:25.053183 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:25.081086 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b06fae96-d331-43c2-b27c-f2e20f51a6d0,revision_number=0']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:25.092333 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.092709 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.093114 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.093516 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.094035 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.094309 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.094705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.095099 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.095511 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.096478 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.096880 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.097274 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.097706 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.098101 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.098493 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.098887 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.099280 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.099671 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.100091 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.100484 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.100876 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.101268 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.101654 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.102041 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84112) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:25.107798 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:25.147484 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group_rule, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:25.148966 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2858531 Feb 17 18:11:25.151652 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 59536) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:25.157301 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-d924f56a-08dc-49b9-b69e-de2e0a529ffa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Request body: {'security_group_rule': {'security_group_id': '1047b73e-d2cc-4503-a589-8a51b6bcca23', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:11:25.164309 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-d924f56a-08dc-49b9-b69e-de2e0a529ffa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:25.168469 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-d924f56a-08dc-49b9-b69e-de2e0a529ffa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Usage tracker for resource:security_group_rule and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:25.171622 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-d924f56a-08dc-49b9-b69e-de2e0a529ffa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:25.178104 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-d924f56a-08dc-49b9-b69e-de2e0a529ffa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:25.222958 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d924f56a-08dc-49b9-b69e-de2e0a529ffa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group_rule, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:25.288318 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d924f56a-08dc-49b9-b69e-de2e0a529ffa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:25.315223 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d924f56a-08dc-49b9-b69e-de2e0a529ffa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629551'] for security_group_rule, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:25.322826 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-95eef0b2-0a0a-4381-9f46-df52142ba2ee tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:25.342114 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d924f56a-08dc-49b9-b69e-de2e0a529ffa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb156853-156d-4265-b360-ff9c3ff08a22,revision_number=0']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:25.344634 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-d924f56a-08dc-49b9-b69e-de2e0a529ffa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:25.389194 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d924f56a-08dc-49b9-b69e-de2e0a529ffa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for security_group_rule, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:25.393549 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-d924f56a-08dc-49b9-b69e-de2e0a529ffa tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2377942 Feb 17 18:11:25.394033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 59542) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:25.400089 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Request body: {'floatingip': {'floating_network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:11:25.406580 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:25.410731 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Usage tracker for resource:floatingip and tenant:bd48a3996f1246f1ab69d3866874af0b is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:25.413774 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:25.419532 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:25.451805 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for floatingip, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:25.605849 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:25.881133 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Allocated IP 172.27.1.134 (68fd415f-8606-43f8-b4d1-98e6a9c9af94/1c895d8f-55ff-4bdb-a323-742172b9934e/88a83b59-f77e-440d-8305-7a284041cf53) {{(pid=84111) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:11:26.035431 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for port, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:26.113573 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:26.129223 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:26.260640 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event updated for resources: {'Port': ['ID=88a83b59-f77e-440d-8305-7a284041cf53,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:26.268292 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:26.318295 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Network 68fd415f-8606-43f8-b4d1-98e6a9c9af94 is already hosted by enough agents. {{(pid=84111) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:11:26.319399 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources bound (agent type, host, resource id): {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:11:26.321787 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Received port after_create {{(pid=84111) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:11:26.405016 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for floatingip, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:26.497176 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:26.779176 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for port, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:26.812062 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4125045'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:26.828661 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-94a787bd-4ae7-46b2-aaaa-82b746f3abeb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:26.966740 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event updated for resources: {'Port': ['ID=88a83b59-f77e-440d-8305-7a284041cf53,revision_number=2']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:26.972212 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:27.074146 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036854376515'] for floatingip, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:27.170674 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for floatingip, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:27.172134 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.7769449 Feb 17 18:11:27.400460 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 59600) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:27.536548 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-eaa623a5-fa25-410d-93d8-18e30cc14064 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:27.553530 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-eaa623a5-fa25-410d-93d8-18e30cc14064 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:27.558012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-eaa623a5-fa25-410d-93d8-18e30cc14064 admin admin] Usage tracker for resource:security_group_rule and tenant:b411f8d81ad04757886dddf15f53726e is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:27.561252 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-eaa623a5-fa25-410d-93d8-18e30cc14064 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:27.568199 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-eaa623a5-fa25-410d-93d8-18e30cc14064 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:27.646365 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-9a4a1d77-57b2-4249-9284-2a298dcbbd95 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Synchronizing usage tracker for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:security_group {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:11:27.662098 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-eaa623a5-fa25-410d-93d8-18e30cc14064 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:27.720052 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-9a4a1d77-57b2-4249-9284-2a298dcbbd95 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Unset dirty status for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:security_group {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:11:27.720267 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-eaa623a5-fa25-410d-93d8-18e30cc14064 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:27.721405 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-9a4a1d77-57b2-4249-9284-2a298dcbbd95 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--465933350&fields=id&tenant_id=bd48a3996f1246f1ab69d3866874af0b HTTP/1.1" status: 200 len: 267 time: 0.3597624 Feb 17 18:11:27.729732 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-277e6832-9d6f-40b7-acf8-1c9020d10fc7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:27.776430 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-eaa623a5-fa25-410d-93d8-18e30cc14064 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b411f8d81ad04757886dddf15f53726e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3747928 Feb 17 18:11:27.777207 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaa623a5-fa25-410d-93d8-18e30cc14064 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eac6728b-65a2-4ab0-822d-49d2b33ee6f0,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:27.779708 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 59606) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:27.782594 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-eaa623a5-fa25-410d-93d8-18e30cc14064 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:27.844190 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2720d608-39c2-4bd2-9dc6-f3af763d90d4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:27.872207 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2720d608-39c2-4bd2-9dc6-f3af763d90d4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:27.887242 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-dcc97d8e-1dcf-41a9-b555-5f72dc44dcbd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:27.888857 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-dcc97d8e-1dcf-41a9-b555-5f72dc44dcbd tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 813 time: 0.1601045 Feb 17 18:11:27.906953 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-3b7e2a78-3051-4d61-a30f-32d5da80b95e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/quotas/bd48a3996f1246f1ab69d3866874af0b HTTP/1.1" status: 200 len: 375 time: 0.0099773 Feb 17 18:11:27.954385 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2720d608-39c2-4bd2-9dc6-f3af763d90d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:27.959891 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-b620f193-f43a-4464-bd06-cf4f78e03c5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:27.973171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2720d608-39c2-4bd2-9dc6-f3af763d90d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eac6728b-65a2-4ab0-822d-49d2b33ee6f0,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:27.976439 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-2720d608-39c2-4bd2-9dc6-f3af763d90d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:27.978516 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2720d608-39c2-4bd2-9dc6-f3af763d90d4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:27.982917 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-2720d608-39c2-4bd2-9dc6-f3af763d90d4 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/eac6728b-65a2-4ab0-822d-49d2b33ee6f0 HTTP/1.1" status: 204 len: 168 time: 0.1990082 Feb 17 18:11:28.007127 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-13d19db3-0aac-4d54-a835-6a3dde86dca1 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Synchronizing usage tracker for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:port {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:11:28.051572 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-13d19db3-0aac-4d54-a835-6a3dde86dca1 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Unset dirty status for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:port {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:11:28.053134 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-13d19db3-0aac-4d54-a835-6a3dde86dca1 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1404741 Feb 17 18:11:28.208966 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-5d939fa0-1cac-423c-9a52-7d72017ff5b4 service neutron] 10.222.0.13 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1413391 Feb 17 18:11:28.398785 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f91b95a1-94d4-4fe3-98d4-7e384291aa0a service neutron] 10.222.0.13 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1817369 Feb 17 18:11:28.442327 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 59622) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:28.462118 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e35f5a8f-4899-4e5b-a972-050b9bddbccd admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:28.479056 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e35f5a8f-4899-4e5b-a972-050b9bddbccd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:28.483187 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e35f5a8f-4899-4e5b-a972-050b9bddbccd admin admin] Usage tracker for resource:security_group_rule and tenant:6e043a582c8342ebaec46989a9113a74 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:28.486409 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e35f5a8f-4899-4e5b-a972-050b9bddbccd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:28.492549 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e35f5a8f-4899-4e5b-a972-050b9bddbccd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:28.611822 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e35f5a8f-4899-4e5b-a972-050b9bddbccd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:28.651418 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e35f5a8f-4899-4e5b-a972-050b9bddbccd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:28.665038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f313fe01-91be-4966-bd68-267a1619103e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:28.675581 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-fc42a190-dfc4-4bce-909f-537da002105e req-8ac70dfc-7972-4ea1-95d0-4e646994b98a tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 210 time: 0.0503607 Feb 17 18:11:28.709664 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e35f5a8f-4899-4e5b-a972-050b9bddbccd admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6e043a582c8342ebaec46989a9113a74&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2661490 Feb 17 18:11:28.711548 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e35f5a8f-4899-4e5b-a972-050b9bddbccd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8de2566d-9e68-4671-bb2e-2823d024a8fe,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:28.713083 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 59632) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:28.715609 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e35f5a8f-4899-4e5b-a972-050b9bddbccd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:28.782664 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f235ef92-b321-41cf-a8cd-d67f2e178cf2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:28.810591 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f235ef92-b321-41cf-a8cd-d67f2e178cf2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:28.891375 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f235ef92-b321-41cf-a8cd-d67f2e178cf2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:28.897170 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-5270a56e-765c-4192-9b6a-11572db2b5d8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:28.911313 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f235ef92-b321-41cf-a8cd-d67f2e178cf2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8de2566d-9e68-4671-bb2e-2823d024a8fe,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:28.914442 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f235ef92-b321-41cf-a8cd-d67f2e178cf2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:28.915649 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f235ef92-b321-41cf-a8cd-d67f2e178cf2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:28.919780 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f235ef92-b321-41cf-a8cd-d67f2e178cf2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8de2566d-9e68-4671-bb2e-2823d024a8fe HTTP/1.1" status: 204 len: 168 time: 0.2052610 Feb 17 18:11:29.864765 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-91aaa7bf-7a17-4cef-8a4d-54a2a3684d84 req-e6a5c391-0456-4723-805b-21e6697ba16d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 210 time: 0.0510814 Feb 17 18:11:30.284306 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 59686) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:30.447295 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-58af3ea3-8401-4caa-bbf1-370022be7187 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:30.485429 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-58af3ea3-8401-4caa-bbf1-370022be7187 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:30.495400 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-58af3ea3-8401-4caa-bbf1-370022be7187 admin admin] Usage tracker for resource:security_group_rule and tenant:17c2c7ffae2546f9bdb417b4a793c4a2 is out of sync, need to count used quota {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:30.506608 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-58af3ea3-8401-4caa-bbf1-370022be7187 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84111) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:30.516600 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-58af3ea3-8401-4caa-bbf1-370022be7187 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:30.527301 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-5f9d2e10-15ff-40dd-b76a-fcc03cac1698 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:30.528886 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-5f9d2e10-15ff-40dd-b76a-fcc03cac1698 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.70 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 813 time: 0.2126007 Feb 17 18:11:30.634236 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-df8294d9-940f-4243-b38a-5f6517d60b1e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=bd48a3996f1246f1ab69d3866874af0b HTTP/1.1" status: 200 len: 5702 time: 0.0900683 Feb 17 18:11:30.650750 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Request body: {'port': {'device_id': '2ac770d4-c8d6-4a2b-90fa-2001b634f273', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'admin_state_up': True, 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'security_groups': ['1047b73e-d2cc-4503-a589-8a51b6bcca23']}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:11:30.788054 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-58af3ea3-8401-4caa-bbf1-370022be7187 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:30.824734 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-58af3ea3-8401-4caa-bbf1-370022be7187 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:30.834493 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1c18d74d-f43f-4968-8638-4a9770cd973e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:30.865073 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:30.890565 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-58af3ea3-8401-4caa-bbf1-370022be7187 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=17c2c7ffae2546f9bdb417b4a793c4a2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6024318 Feb 17 18:11:30.891760 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 59712) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:30.895124 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=84111) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:30.897397 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58af3ea3-8401-4caa-bbf1-370022be7187 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec976e18-a40f-459f-847b-f85d1dfe044a,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:30.901019 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-58af3ea3-8401-4caa-bbf1-370022be7187 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:30.948991 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Made reservation on behalf of bd48a3996f1246f1ab69d3866874af0b for: {'port': 1} {{(pid=84111) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:55}} Feb 17 18:11:30.955066 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:30.964709 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-719d9d9b-080a-4661-9e3a-55c059a15fa2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:30.995037 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-719d9d9b-080a-4661-9e3a-55c059a15fa2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:31.103306 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-719d9d9b-080a-4661-9e3a-55c059a15fa2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:31.108700 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f09208e4-e187-410d-b078-272fa46e375e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:31.124576 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-719d9d9b-080a-4661-9e3a-55c059a15fa2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec976e18-a40f-459f-847b-f85d1dfe044a,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:31.133657 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-719d9d9b-080a-4661-9e3a-55c059a15fa2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:31.133657 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-719d9d9b-080a-4661-9e3a-55c059a15fa2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:31.141704 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-6e4022a7-fad4-4005-ad6b-ad7349380f2d req-00f9378e-1787-4e2e-b0c8-631fe0775b9d tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 210 time: 0.1156480 Feb 17 18:11:31.144318 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-719d9d9b-080a-4661-9e3a-55c059a15fa2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ec976e18-a40f-459f-847b-f85d1dfe044a HTTP/1.1" status: 204 len: 168 time: 0.2500613 Feb 17 18:11:31.344902 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.db_base_plugin_common [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Allocated IP 172.20.0.11 (8e56c377-33ba-47b0-9d75-fa2421d9f1e2/2f43211a-7773-487d-8b86-a136c7f7c156/b0cd9fce-7034-4af7-8516-b7d5d3eaf552) {{(pid=84111) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:136}} Feb 17 18:11:31.550734 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for port, precommit_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:31.568403 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Transition to ACTIVE for port object b0cd9fce-7034-4af7-8516-b7d5d3eaf552 will not be triggered until provisioned by entity DHCP. {{(pid=84111) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:11:31.634750 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port--9223363306798401038', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_create {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:31.650873 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-98a09e83-7f38-49b3-84c8-5ae66653c80f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:31.792284 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Pushing event updated for resources: {'Port': ['ID=b0cd9fce-7034-4af7-8516-b7d5d3eaf552,revision_number=1']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:31.797042 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:31.851545 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 is already hosted by enough agents. {{(pid=84111) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:276}} Feb 17 18:11:31.852730 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.base_scheduler [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Resources bound (agent type, host, resource id): {{(pid=84111) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:58}} Feb 17 18:11:31.854994 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Received port after_create {{(pid=84111) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:524}} Feb 17 18:11:31.925882 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:31.926594 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:31.983794 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-f7d5ab49-996a-4aee-9f27-db6134474dd6 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3388319 Feb 17 18:11:31.996289 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Request body: {'port': {'device_id': '2ac770d4-c8d6-4a2b-90fa-2001b634f273', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:11:32.130842 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:32.223361 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-3468577e-6a1c-498a-ad39-b31cc34476cc None None] Provisioning for port b0cd9fce-7034-4af7-8516-b7d5d3eaf552 completed by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:11:32.232250 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-3468577e-6a1c-498a-ad39-b31cc34476cc None None] Provisioning complete for port b0cd9fce-7034-4af7-8516-b7d5d3eaf552 triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:11:32.233594 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3468577e-6a1c-498a-ad39-b31cc34476cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:32.297513 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-3468577e-6a1c-498a-ad39-b31cc34476cc None None] Port b0cd9fce-7034-4af7-8516-b7d5d3eaf552 cannot update to ACTIVE because it is not bound. {{(pid=84113) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:332}} Feb 17 18:11:32.538561 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a25ed6f9-9379-4155-8357-ac8acdb3dd92 req-0a055f61-7399-4ce2-93d7-2b22dc2d9104 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:32.539336 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-a25ed6f9-9379-4155-8357-ac8acdb3dd92 req-0a055f61-7399-4ce2-93d7-2b22dc2d9104 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Synchronizing usage tracker for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:port {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:11:32.614033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-a25ed6f9-9379-4155-8357-ac8acdb3dd92 req-0a055f61-7399-4ce2-93d7-2b22dc2d9104 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Unset dirty status for tenant:bd48a3996f1246f1ab69d3866874af0b on resource:port {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:11:32.618405 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a25ed6f9-9379-4155-8357-ac8acdb3dd92 req-0a055f61-7399-4ce2-93d7-2b22dc2d9104 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 932 time: 0.2821944 Feb 17 18:11:32.712257 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b0cd9fce-7034-4af7-8516-b7d5d3eaf552 {{(pid=84111) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:229}} Feb 17 18:11:32.719578 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Notify callbacks [] for port, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:32.728532 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a25ed6f9-9379-4155-8357-ac8acdb3dd92 req-3c8fe7ab-415e-4fee-a3f6-6885b1b7b078 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=1047b73e-d2cc-4503-a589-8a51b6bcca23&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0774467 Feb 17 18:11:32.788892 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Transition to ACTIVE for port object b0cd9fce-7034-4af7-8516-b7d5d3eaf552 will not be triggered until provisioned by entity L2. {{(pid=84111) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:75}} Feb 17 18:11:32.846763 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4125045'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:32.864496 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-8eae50e5-1b53-4ba1-99da-000c309a6b22 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:33.000002 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Pushing event updated for resources: {'Port': ['ID=b0cd9fce-7034-4af7-8516-b7d5d3eaf552,revision_number=2']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:33.005023 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:33.269284 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Attempting to bind port b0cd9fce-7034-4af7-8516-b7d5d3eaf552 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 17 18:11:33.269664 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Attempting to bind port b0cd9fce-7034-4af7-8516-b7d5d3eaf552 by drivers openvswitch on host hv-cinder-76019 at level 0 using segments [{'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'}] {{(pid=84111) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:822}} Feb 17 18:11:33.270080 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Attempting to bind port b0cd9fce-7034-4af7-8516-b7d5d3eaf552 on network 8e56c377-33ba-47b0-9d75-fa2421d9f1e2 {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:89}} Feb 17 18:11:33.275991 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Checking agent: {'id': '35b9bf9c-0314-48b9-bb29-ba3a04c8b13c', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 2, 17, 18, 4, 47), 'started_at': datetime.datetime(2021, 2, 17, 18, 5, 17), 'heartbeat_timestamp': datetime.datetime(2021, 2, 17, 18, 11, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': ['vxlan'], 'tunneling_ip': '192.168.0.34', 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.1', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Feb 17 18:11:33.276372 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Checking segment: {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'} for mappings: {} with network types: ['vxlan', 'local', 'flat', 'vlan'] {{(pid=84111) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:345}} Feb 17 18:11:33.276772 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:33.277168 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Bound using segment: {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'} {{(pid=84111) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Feb 17 18:11:33.277641 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.managers [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Bound port: b0cd9fce-7034-4af7-8516-b7d5d3eaf552, host: hv-cinder-76019, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a3b9a246-e8d6-47cc-bbb0-e0531b20a903', 'network_type': 'vxlan', 'physical_network': None, 'segmentation_id': 5, 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2'}}] {{(pid=84111) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:937}} Feb 17 18:11:33.278018 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:33.386515 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] For port b0cd9fce-7034-4af7-8516-b7d5d3eaf552, host hv-cinder-76019, cleared binding levels {{(pid=84111) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:90}} Feb 17 18:11:33.389664 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] For port b0cd9fce-7034-4af7-8516-b7d5d3eaf552, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=b0cd9fce-7034-4af7-8516-b7d5d3eaf552,segment=NetworkSegment(a3b9a246-e8d6-47cc-bbb0-e0531b20a903),segment_id=a3b9a246-e8d6-47cc-bbb0-e0531b20a903)] {{(pid=84111) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:63}} Feb 17 18:11:33.429503 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4125045'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:33.446050 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:33.597361 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Pushing event updated for resources: {'Port': ['ID=b0cd9fce-7034-4af7-8516-b7d5d3eaf552,revision_number=3']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:33.610519 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:33.648515 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:33.649247 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:33.652212 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] 10.222.0.70 "PUT /v2.0/ports/b0cd9fce-7034-4af7-8516-b7d5d3eaf552 HTTP/1.1" status: 200 len: 1158 time: 1.6607251 Feb 17 18:11:33.652788 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2ac770d4-c8d6-4a2b-90fa-2001b634f273', 'tag': 'b0cd9fce-7034-4af7-8516-b7d5d3eaf552'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:11:33.720948 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2ac770d4-c8d6-4a2b-90fa-2001b634f273', 'tag': 'b0cd9fce-7034-4af7-8516-b7d5d3eaf552', 'status': 'completed', 'code': 200} Feb 17 18:11:34.136833 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b384c835-96ad-4cab-a776-bbe0aaab202c req-755e2205-cb16-4ccf-9a9f-4ac2d8df657e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:34.138474 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b384c835-96ad-4cab-a776-bbe0aaab202c req-755e2205-cb16-4ccf-9a9f-4ac2d8df657e service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 1161 time: 0.3931036 Feb 17 18:11:34.148865 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57813166-7a16-4f78-8480-df6086d233e0 req-db808312-3cb6-474e-b707-80158531de8e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:34.150414 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-57813166-7a16-4f78-8480-df6086d233e0 req-db808312-3cb6-474e-b707-80158531de8e tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 944 time: 0.1098864 Feb 17 18:11:34.188284 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 59896) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:34.300613 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-57813166-7a16-4f78-8480-df6086d233e0 req-aabbd4b1-2813-47c1-8a0f-1305b2703c0c tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=1047b73e-d2cc-4503-a589-8a51b6bcca23&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1257524 Feb 17 18:11:34.329998 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1e5523e4-0d7a-46c3-88b7-9832eba06934 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:34.347062 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b384c835-96ad-4cab-a776-bbe0aaab202c req-894ed0d3-bc83-4b66-ae3f-238370b9fcac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:34.347278 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-1e5523e4-0d7a-46c3-88b7-9832eba06934 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:34.348740 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b384c835-96ad-4cab-a776-bbe0aaab202c req-894ed0d3-bc83-4b66-ae3f-238370b9fcac service neutron] 10.222.0.70 "GET /v2.0/networks?tenant_id=bd48a3996f1246f1ab69d3866874af0b&shared=False HTTP/1.1" status: 200 len: 907 time: 0.1973994 Feb 17 18:11:34.351286 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-1e5523e4-0d7a-46c3-88b7-9832eba06934 admin admin] Usage tracker for resource:security_group_rule and tenant:50607064951649c4bc1386bda20ad7cf is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:34.354406 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-1e5523e4-0d7a-46c3-88b7-9832eba06934 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:34.360441 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-1e5523e4-0d7a-46c3-88b7-9832eba06934 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:34.452552 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1e5523e4-0d7a-46c3-88b7-9832eba06934 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:34.490085 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-1e5523e4-0d7a-46c3-88b7-9832eba06934 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:34.499361 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9099637e-8504-41cf-b445-048839d87dc2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:34.503034 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b384c835-96ad-4cab-a776-bbe0aaab202c req-d204e03b-e163-4a66-8fbc-254b0d076724 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:34.504739 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b384c835-96ad-4cab-a776-bbe0aaab202c req-d204e03b-e163-4a66-8fbc-254b0d076724 service neutron] 10.222.0.70 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 863 time: 0.1489832 Feb 17 18:11:34.542297 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-1e5523e4-0d7a-46c3-88b7-9832eba06934 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=50607064951649c4bc1386bda20ad7cf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3527427 Feb 17 18:11:34.545344 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 59908) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:34.546513 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e5523e4-0d7a-46c3-88b7-9832eba06934 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=595ad5d9-f89e-4875-9323-3045c6eab35f,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:34.550259 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1e5523e4-0d7a-46c3-88b7-9832eba06934 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:34.678387 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-55e07fd2-c42e-4398-b9c9-900e1bc84065 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:34.712349 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-52f190ba-e52b-444d-a02f-2d0f01cc0d22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:34.714272 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-52f190ba-e52b-444d-a02f-2d0f01cc0d22 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 1161 time: 0.1503680 Feb 17 18:11:34.718686 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-55e07fd2-c42e-4398-b9c9-900e1bc84065 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:34.809354 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-044cb1ff-f035-4a22-83b6-dec62cf81a28 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b0cd9fce-7034-4af7-8516-b7d5d3eaf552 HTTP/1.1" status: 200 len: 217 time: 0.0809352 Feb 17 18:11:34.892666 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-b91a9d81-1c1d-4a14-9568-c8613d5060a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:34.894268 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-b91a9d81-1c1d-4a14-9568-c8613d5060a0 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2f43211a-7773-487d-8b86-a136c7f7c156 HTTP/1.1" status: 200 len: 852 time: 0.0734332 Feb 17 18:11:34.941915 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-55e07fd2-c42e-4398-b9c9-900e1bc84065 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:34.951995 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-8fa1cb53-090f-47de-b1d3-acb3bd25143f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:34.971375 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55e07fd2-c42e-4398-b9c9-900e1bc84065 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=595ad5d9-f89e-4875-9323-3045c6eab35f,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:34.976291 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-55e07fd2-c42e-4398-b9c9-900e1bc84065 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:34.981883 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-55e07fd2-c42e-4398-b9c9-900e1bc84065 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:34.985709 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-55e07fd2-c42e-4398-b9c9-900e1bc84065 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/595ad5d9-f89e-4875-9323-3045c6eab35f HTTP/1.1" status: 204 len: 168 time: 0.4367025 Feb 17 18:11:35.009671 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-cbf7fa75-3539-4d51-9364-132b09695f3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:35.011331 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-cbf7fa75-3539-4d51-9364-132b09695f3f service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1101835 Feb 17 18:11:35.170317 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-815a3db2-b821-4012-9da0-3176cc10107d service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1448839 Feb 17 18:11:35.325617 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-1cd550d9-92c1-4d83-8f6e-d2687df30fae req-6baf011b-78bc-4358-ad6a-dd98d36125a3 service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1478093 Feb 17 18:11:35.456924 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 59920) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:35.478621 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ae4b9a22-aafc-49eb-826d-4e1b358b2196 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:35.497414 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-ae4b9a22-aafc-49eb-826d-4e1b358b2196 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:35.502174 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-ae4b9a22-aafc-49eb-826d-4e1b358b2196 admin admin] Usage tracker for resource:security_group_rule and tenant:825cf2712f1548ccb2fc13e717a541d4 is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:35.506059 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-ae4b9a22-aafc-49eb-826d-4e1b358b2196 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:35.512456 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-ae4b9a22-aafc-49eb-826d-4e1b358b2196 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:35.517782 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48ec8b9-a172-4dd8-91fe-92478996f5e7 req-08008e94-5694-4f88-9a9e-fe379032b34c tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:35.519466 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c48ec8b9-a172-4dd8-91fe-92478996f5e7 req-08008e94-5694-4f88-9a9e-fe379032b34c tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 944 time: 0.0941164 Feb 17 18:11:35.577191 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-c48ec8b9-a172-4dd8-91fe-92478996f5e7 req-9736be60-903a-4974-847f-c4ebadbbab4c tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=1047b73e-d2cc-4503-a589-8a51b6bcca23&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500546 Feb 17 18:11:35.607241 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ae4b9a22-aafc-49eb-826d-4e1b358b2196 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:35.680270 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ae4b9a22-aafc-49eb-826d-4e1b358b2196 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:35.690489 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3c44fc63-7100-458a-ac17-9055fa0f6d5f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:35.735538 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-ae4b9a22-aafc-49eb-826d-4e1b358b2196 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=825cf2712f1548ccb2fc13e717a541d4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2774241 Feb 17 18:11:35.738285 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 59926) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:35.741206 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae4b9a22-aafc-49eb-826d-4e1b358b2196 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c46495fb-0c0d-40e6-b81d-31cf7362c7b0,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:35.754439 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-ae4b9a22-aafc-49eb-826d-4e1b358b2196 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:35.810431 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f6b6b550-9ec9-459e-afba-2dab29b3763d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:35.813569 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2b9763bc-fac7-4714-9ff0-88b027a7b091 req-89012438-30b0-4b00-895b-e0c20aee8dbd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-TestMinimumBasicScenario-721487347&fields=id&tenant_id=5729c656e2c64606a663d6434a5c3973 HTTP/1.1" status: 200 len: 267 time: 0.0441210 Feb 17 18:11:35.839115 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f6b6b550-9ec9-459e-afba-2dab29b3763d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:35.905093 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b9763bc-fac7-4714-9ff0-88b027a7b091 req-25214605-eea6-4cd4-b82b-ad600e31c72c tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:35.906608 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2b9763bc-fac7-4714-9ff0-88b027a7b091 req-25214605-eea6-4cd4-b82b-ad600e31c72c tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 984 time: 0.0863316 Feb 17 18:11:35.918487 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [req-2b9763bc-fac7-4714-9ff0-88b027a7b091 req-5103a03f-0c98-477d-bdb7-20c0a5e76762 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Request body: {'port': {'security_groups': ['d20c28cb-f883-4a6f-897a-3150a1a1bbfe']}} {{(pid=84111) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:11:35.919973 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f6b6b550-9ec9-459e-afba-2dab29b3763d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:35.925221 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-7bab1680-c9a4-4861-958d-e5beb801c161 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:35.938445 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6b6b550-9ec9-459e-afba-2dab29b3763d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c46495fb-0c0d-40e6-b81d-31cf7362c7b0,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:35.942280 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f6b6b550-9ec9-459e-afba-2dab29b3763d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:35.957072 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f6b6b550-9ec9-459e-afba-2dab29b3763d admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:35.958506 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f6b6b550-9ec9-459e-afba-2dab29b3763d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c46495fb-0c0d-40e6-b81d-31cf7362c7b0 HTTP/1.1" status: 204 len: 168 time: 0.2192421 Feb 17 18:11:36.060414 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-2b9763bc-fac7-4714-9ff0-88b027a7b091 req-5103a03f-0c98-477d-bdb7-20c0a5e76762 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:36.392723 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-2b9763bc-fac7-4714-9ff0-88b027a7b091 req-5103a03f-0c98-477d-bdb7-20c0a5e76762 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] For port e5b8b8b3-6466-4164-8a2d-7627684ce9d0, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0,segment=NetworkSegment(26bc7590-668d-4f62-883e-3f8e0fb997b0),segment_id=26bc7590-668d-4f62-883e-3f8e0fb997b0)] {{(pid=84111) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:11:36.421993 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-2b9763bc-fac7-4714-9ff0-88b027a7b091 req-5103a03f-0c98-477d-bdb7-20c0a5e76762 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for port, precommit_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:36.457307 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-2b9763bc-fac7-4714-9ff0-88b027a7b091 req-5103a03f-0c98-477d-bdb7-20c0a5e76762 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4125045'] for port, after_update {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:36.472735 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-05b4d1f9-e283-4fe2-aa1e-63b97eaa063d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:36.625099 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5103a03f-0c98-477d-bdb7-20c0a5e76762 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Pushing event updated for resources: {'Port': ['ID=e5b8b8b3-6466-4164-8a2d-7627684ce9d0,revision_number=6']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:36.642469 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-5103a03f-0c98-477d-bdb7-20c0a5e76762 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:36.714369 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b9763bc-fac7-4714-9ff0-88b027a7b091 req-5103a03f-0c98-477d-bdb7-20c0a5e76762 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:36.714369 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-2b9763bc-fac7-4714-9ff0-88b027a7b091 req-5103a03f-0c98-477d-bdb7-20c0a5e76762 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:36.720678 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-2b9763bc-fac7-4714-9ff0-88b027a7b091 req-5103a03f-0c98-477d-bdb7-20c0a5e76762 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "PUT /v2.0/ports/e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 942 time: 0.8070452 Feb 17 18:11:36.722021 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:11:36.863026 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d8da154e-935b-4ef4-a017-60b512bfdfa2 req-303f2c9d-fadb-4f17-be24-04be645441d4 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups/72d18d1b-1457-452a-9e65-49d155c0fafe HTTP/1.1" status: 200 len: 3003 time: 0.0942187 Feb 17 18:11:36.874806 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7a982a0-d9e7-4b8b-bf02-36b365ffdac8 req-a4b3f7fc-a8a5-4d36-ba38-038ef35b2105 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:36.876623 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d7a982a0-d9e7-4b8b-bf02-36b365ffdac8 req-a4b3f7fc-a8a5-4d36-ba38-038ef35b2105 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 944 time: 0.1489339 Feb 17 18:11:36.971274 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d7a982a0-d9e7-4b8b-bf02-36b365ffdac8 req-a7a5f296-666a-4982-adc1-a0d32ca1e79c tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=1047b73e-d2cc-4503-a589-8a51b6bcca23&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0806923 Feb 17 18:11:36.999564 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-d8da154e-935b-4ef4-a017-60b512bfdfa2 req-f60808ea-6a74-4e07-bb36-a9717fbaf92b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:37.004032 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-52569e2f-cfc9-46a9-a0be-45104dd12e16 None None] Provisioning complete for port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 triggered by entity DHCP. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:11:37.004681 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-52569e2f-cfc9-46a9-a0be-45104dd12e16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:37.023320 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-d8da154e-935b-4ef4-a017-60b512bfdfa2 req-f60808ea-6a74-4e07-bb36-a9717fbaf92b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:37.063216 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0', 'status': 'completed', 'code': 200} Feb 17 18:11:37.124734 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-d8da154e-935b-4ef4-a017-60b512bfdfa2 req-f60808ea-6a74-4e07-bb36-a9717fbaf92b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:37.135898 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9216da80-f412-4654-b2dd-a8efdde3f981 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:37.166779 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f60808ea-6a74-4e07-bb36-a9717fbaf92b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=72d18d1b-1457-452a-9e65-49d155c0fafe,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:37.170775 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f60808ea-6a74-4e07-bb36-a9717fbaf92b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:37.193722 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c0b8d1-b52a-4d19-ad67-c6754b2c299b req-c0cff68e-efe3-4688-a620-60613e98c911 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:37.195596 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94c0b8d1-b52a-4d19-ad67-c6754b2c299b req-c0cff68e-efe3-4688-a620-60613e98c911 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=5729c656e2c64606a663d6434a5c3973&device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 1162 time: 0.1129913 Feb 17 18:11:37.294258 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-d8da154e-935b-4ef4-a017-60b512bfdfa2 req-f60808ea-6a74-4e07-bb36-a9717fbaf92b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:37.295486 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-d8da154e-935b-4ef4-a017-60b512bfdfa2 req-f60808ea-6a74-4e07-bb36-a9717fbaf92b tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "DELETE /v2.0/security-groups/72d18d1b-1457-452a-9e65-49d155c0fafe HTTP/1.1" status: 204 len: 173 time: 0.4177134 Feb 17 18:11:37.445583 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c0b8d1-b52a-4d19-ad67-c6754b2c299b req-2346c292-924c-442b-b626-a68203f94def service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:37.445583 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94c0b8d1-b52a-4d19-ad67-c6754b2c299b req-2346c292-924c-442b-b626-a68203f94def service neutron] 10.222.0.70 "GET /v2.0/networks?id=6755b14b-f6f6-43aa-a697-3921175c5230 HTTP/1.1" status: 200 len: 909 time: 0.2420940 Feb 17 18:11:37.535734 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-f67b2da9-d5c4-4a8f-9a71-fa2e9f383a85 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/floatingips/d16e92b6-080c-4b6e-b2ce-a52b5f44c6fe HTTP/1.1" status: 200 len: 998 time: 0.2195566 Feb 17 18:11:37.663474 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94c0b8d1-b52a-4d19-ad67-c6754b2c299b req-2fd3758c-c6d2-4849-9b88-eb4d466766b0 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 1001 time: 0.2104113 Feb 17 18:11:37.698224 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c18e432e-b6f8-461d-8c22-3b22fa6196b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:37.781912 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c0b8d1-b52a-4d19-ad67-c6754b2c299b req-a82230fc-5869-4c99-bf91-c1181a3d3d44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:37.783532 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94c0b8d1-b52a-4d19-ad67-c6754b2c299b req-a82230fc-5869-4c99-bf91-c1181a3d3d44 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=8a96f440-286f-407f-9d7e-b3b2727a69a9 HTTP/1.1" status: 200 len: 854 time: 0.1121109 Feb 17 18:11:37.790680 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-89a1935a-4abb-4179-8765-d8c8be0cd75c tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:37.792107 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-89a1935a-4abb-4179-8765-d8c8be0cd75c tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/networks/68fd415f-8606-43f8-b4d1-98e6a9c9af94 HTTP/1.1" status: 200 len: 784 time: 0.2461827 Feb 17 18:11:37.843839 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-f202c804-402d-499e-9987-b591bf9d250f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=84111) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 17 18:11:37.844925 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-f202c804-402d-499e-9987-b591bf9d250f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13455 time: 0.0112865 Feb 17 18:11:37.971378 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-314a2c79-d777-4a9b-8baa-b83d248d5c7e tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.27.1.226 HTTP/1.1" status: 200 len: 1001 time: 0.1197071 Feb 17 18:11:37.977667 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c0b8d1-b52a-4d19-ad67-c6754b2c299b req-26d34f20-e270-43d2-b673-8b9c889c3ec7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:37.979205 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94c0b8d1-b52a-4d19-ad67-c6754b2c299b req-26d34f20-e270-43d2-b673-8b9c889c3ec7 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=6755b14b-f6f6-43aa-a697-3921175c5230&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1862113 Feb 17 18:11:38.445975 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-e76fe3c5-65e0-45e8-aef5-d026fdf76df9 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:38.447448 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-e76fe3c5-65e0-45e8-aef5-d026fdf76df9 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports/e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 942 time: 0.4672675 Feb 17 18:11:38.503928 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94c0b8d1-b52a-4d19-ad67-c6754b2c299b req-733d7cbf-95b8-48f4-860d-e94d4a8b0f3b service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4819000 Feb 17 18:11:38.515751 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2b2a9cf-ad10-4787-9c95-080556556715 req-0ad24d97-01b8-44db-8751-05345279876f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:38.517491 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b2b2a9cf-ad10-4787-9c95-080556556715 req-0ad24d97-01b8-44db-8751-05345279876f tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 944 time: 0.1621945 Feb 17 18:11:38.696284 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e5b8b8b3-6466-4164-8a2d-7627684ce9d0 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:11:38.755339 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-b2b2a9cf-ad10-4787-9c95-080556556715 req-36cf7a91-93b5-456b-a355-d97c7d1631c9 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=1047b73e-d2cc-4503-a589-8a51b6bcca23&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2143433 Feb 17 18:11:38.785501 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-5cab5ab9-e4b6-4961-b02f-d9cc12fbde5f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.27.1.226 HTTP/1.1" status: 200 len: 1001 time: 0.1733501 Feb 17 18:11:38.798198 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:11:38.798913 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:38.811719 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-94c0b8d1-b52a-4d19-ad67-c6754b2c299b req-3664c3f1-9ea8-4c15-99a6-0f4ff2969070 service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2931385 Feb 17 18:11:39.053985 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Deleting port 146ee682-cfe9-4336-9404-1f419a819989 {{(pid=84111) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:11:39.054442 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:39.103219 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device b0cd9fce-7034-4af7-8516-b7d5d3eaf552 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:11:39.199890 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning for port b0cd9fce-7034-4af7-8516-b7d5d3eaf552 completed by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:134}} Feb 17 18:11:39.206240 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port b0cd9fce-7034-4af7-8516-b7d5d3eaf552 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:11:39.206665 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:39.245608 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:39.245979 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:39.334097 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1564703'] for port, before_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:39.362886 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2ac770d4-c8d6-4a2b-90fa-2001b634f273', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b0cd9fce-7034-4af7-8516-b7d5d3eaf552'}] {{(pid=84113) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:11:39.373249 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] For port b0cd9fce-7034-4af7-8516-b7d5d3eaf552, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=b0cd9fce-7034-4af7-8516-b7d5d3eaf552,segment=NetworkSegment(a3b9a246-e8d6-47cc-bbb0-e0531b20a903),segment_id=a3b9a246-e8d6-47cc-bbb0-e0531b20a903)] {{(pid=84113) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:11:39.381737 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Calling delete_port for 146ee682-cfe9-4336-9404-1f419a819989 owned by network:floatingip {{(pid=84111) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:11:39.410096 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed--9223363306798023659', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update--9223363306798401788', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8730056374046'] for port, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:39.413455 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:39.455414 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2ac770d4-c8d6-4a2b-90fa-2001b634f273', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b0cd9fce-7034-4af7-8516-b7d5d3eaf552', 'code': 200} Feb 17 18:11:39.491490 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Pushing event updated for resources: {'Port': ['ID=b0cd9fce-7034-4af7-8516-b7d5d3eaf552,revision_number=4']} {{(pid=84113) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:39.499619 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.500038 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.500464 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.500840 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.501230 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.502160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.502528 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.502892 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.503254 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.503614 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.503996 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.504362 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@hv-cinder-76019 {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.504760 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type AddressGroup changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.505121 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.505481 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.505835 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.506192 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.506550 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.506905 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.507296 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.507662 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.508067 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.508427 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.508779 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760194-3-iscsi {{(pid=84113) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:119}} Feb 17 18:11:39.513458 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=84113) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:39.587332 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:39.603705 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:39.734816 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Pushing event deleted for resources: {'Port': ['ID=146ee682-cfe9-4336-9404-1f419a819989,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:39.745579 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:39.842504 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f03554a-39cb-41fa-aaaa-dfe2f683b825 req-48fe19e3-cff8-447c-9268-f77dda9080fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:39.844152 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3f03554a-39cb-41fa-aaaa-dfe2f683b825 req-48fe19e3-cff8-447c-9268-f77dda9080fa service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 1163 time: 0.1475286 Feb 17 18:11:39.855964 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-62bafc9a-6770-4f34-8ff3-ca91c707e8b1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:39.999829 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks [] for floatingip, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:40.000229 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.l3_db [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Floating IP d16e92b6-080c-4b6e-b2ce-a52b5f44c6fe disassociated (deleted). External IP: 172.27.1.226, port: e5b8b8b3-6466-4164-8a2d-7627684ce9d0. Feb 17 18:11:40.060266 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3f03554a-39cb-41fa-aaaa-dfe2f683b825 req-93ad6605-4d71-433b-a8d0-e8875467a07d service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=1047b73e-d2cc-4503-a589-8a51b6bcca23&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1828725 Feb 17 18:11:40.170767 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device b0cd9fce-7034-4af7-8516-b7d5d3eaf552 up at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:279}} Feb 17 18:11:40.197821 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48eb1ea4-db86-4b7d-a426-eb559d8675f2 req-988bc517-2607-49bb-8d25-1255cb3f03fb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:40.199421 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-48eb1ea4-db86-4b7d-a426-eb559d8675f2 req-988bc517-2607-49bb-8d25-1255cb3f03fb tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 946 time: 0.2910199 Feb 17 18:11:40.248506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.provisioning_blocks [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Provisioning complete for port b0cd9fce-7034-4af7-8516-b7d5d3eaf552 triggered by entity L2. {{(pid=84113) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:140}} Feb 17 18:11:40.248930 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1542807'] for port, provisioning_complete {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:40.410256 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-48eb1ea4-db86-4b7d-a426-eb559d8675f2 req-7ec402d5-6d1a-4936-b800-c2deec779dde tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=1047b73e-d2cc-4503-a589-8a51b6bcca23&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2024758 Feb 17 18:11:40.461928 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Router 742dfc39-339a-428f-8a3f-88d236afaaf4 has already been hosted by L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b {{(pid=84111) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:130}} Feb 17 18:11:40.863113 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:40.906003 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84111) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:11:40.916613 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7126381f-44d6-4fc9-8f7b-14eaef319c1e None None] Sync routers for ids ['742dfc39-339a-428f-8a3f-88d236afaaf4'] in dv-cinder-760194-3-iscsi {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:11:40.926583 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7126381f-44d6-4fc9-8f7b-14eaef319c1e None None] Routers {'742dfc39-339a-428f-8a3f-88d236afaaf4'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:11:40.927260 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-7126381f-44d6-4fc9-8f7b-14eaef319c1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:11:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['742dfc39-339a-428f-8a3f-88d236afaaf4'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:40.984059 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for floatingip, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:41.043605 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-da372a37-e073-4836-a856-e05d2e913b05 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "DELETE /v2.0/floatingips/d16e92b6-080c-4b6e-b2ce-a52b5f44c6fe HTTP/1.1" status: 204 len: 173 time: 2.2306612 Feb 17 18:11:41.044180 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:11:41.118412 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0', 'status': 'completed', 'code': 200} Feb 17 18:11:41.130012 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-7126381f-44d6-4fc9-8f7b-14eaef319c1e None None] Set router 742dfc39-339a-428f-8a3f-88d236afaaf4 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:11:41.213093 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-df9e1ab1-8150-4970-88e8-70039cd0ba09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:41.214917 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-df9e1ab1-8150-4970-88e8-70039cd0ba09 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=5729c656e2c64606a663d6434a5c3973&device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 1162 time: 0.1491690 Feb 17 18:11:41.326385 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79e0069-2159-4a02-af60-db4b2ab0ea2d req-90ac3187-1898-4ab0-97a7-110f8ba30187 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:41.328201 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a79e0069-2159-4a02-af60-db4b2ab0ea2d req-90ac3187-1898-4ab0-97a7-110f8ba30187 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=5729c656e2c64606a663d6434a5c3973&device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 1162 time: 0.1888778 Feb 17 18:11:41.471832 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-107bda9b-b415-4cea-af6b-daf0bc01af74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:41.473415 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-107bda9b-b415-4cea-af6b-daf0bc01af74 service neutron] 10.222.0.13 "GET /v2.0/networks?id=6755b14b-f6f6-43aa-a697-3921175c5230 HTTP/1.1" status: 200 len: 909 time: 0.2506981 Feb 17 18:11:41.499083 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-7126381f-44d6-4fc9-8f7b-14eaef319c1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:08:48Z', 'revision_number': 4, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': 'babc7f9f-a62e-4d31-9f66-a2e5ad339378', 'name': '', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'mac_address': 'fa:16:3e:6a:c4:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:47Z', 'updated_at': '2021-02-17T18:08:59Z', 'revision_number': 5, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'subnets': [{'id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:41.503941 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7126381f-44d6-4fc9-8f7b-14eaef319c1e None None] Checking router: 742dfc39-339a-428f-8a3f-88d236afaaf4 for host: dv-cinder-760194-3-iscsi {{(pid=84113) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:11:41.513678 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7126381f-44d6-4fc9-8f7b-14eaef319c1e None None] Routers {'742dfc39-339a-428f-8a3f-88d236afaaf4'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:11:41.514382 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-7126381f-44d6-4fc9-8f7b-14eaef319c1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:11:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['742dfc39-339a-428f-8a3f-88d236afaaf4'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:41.606084 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-257616b4-e220-4403-8780-c65b0d7f64bb service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 217 time: 0.1221352 Feb 17 18:11:41.691286 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79e0069-2159-4a02-af60-db4b2ab0ea2d req-505ed04a-6be2-4d6f-b0c6-29b2eab73be4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:41.692992 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a79e0069-2159-4a02-af60-db4b2ab0ea2d req-505ed04a-6be2-4d6f-b0c6-29b2eab73be4 service neutron] 10.222.0.70 "GET /v2.0/networks?id=6755b14b-f6f6-43aa-a697-3921175c5230 HTTP/1.1" status: 200 len: 909 time: 0.3567719 Feb 17 18:11:41.716146 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-7126381f-44d6-4fc9-8f7b-14eaef319c1e None None] Set router 742dfc39-339a-428f-8a3f-88d236afaaf4 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:11:41.784270 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a79e0069-2159-4a02-af60-db4b2ab0ea2d req-6b986e0c-917e-4bd6-9d5f-37ea91318fe3 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 217 time: 0.0813766 Feb 17 18:11:41.830546 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-9f001655-c178-4283-b3eb-6f585ee6bcbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:41.832375 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-9f001655-c178-4283-b3eb-6f585ee6bcbe service neutron] 10.222.0.13 "GET /v2.0/subnets?id=8a96f440-286f-407f-9d7e-b3b2727a69a9 HTTP/1.1" status: 200 len: 854 time: 0.2112305 Feb 17 18:11:41.917240 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3437d2a7-3525-4d2d-9a23-1037575892fb req-15fc99c0-2e79-4f25-aa7c-b575602c9b2b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:41.918951 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3437d2a7-3525-4d2d-9a23-1037575892fb req-15fc99c0-2e79-4f25-aa7c-b575602c9b2b tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 946 time: 0.3666036 Feb 17 18:11:41.964561 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79e0069-2159-4a02-af60-db4b2ab0ea2d req-1d42002f-6358-42a3-b99a-2d1f6c0848d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:41.966631 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a79e0069-2159-4a02-af60-db4b2ab0ea2d req-1d42002f-6358-42a3-b99a-2d1f6c0848d1 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=8a96f440-286f-407f-9d7e-b3b2727a69a9 HTTP/1.1" status: 200 len: 854 time: 0.1734943 Feb 17 18:11:42.062493 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-3437d2a7-3525-4d2d-9a23-1037575892fb req-06dba066-3f53-4230-9582-f1b539780f39 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/security-groups?id=1047b73e-d2cc-4503-a589-8a51b6bcca23&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1317105 Feb 17 18:11:42.083528 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-4c50cb44-acc5-4e0b-b099-e565e6f0a886 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:42.085204 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-4c50cb44-acc5-4e0b-b099-e565e6f0a886 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=6755b14b-f6f6-43aa-a697-3921175c5230&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2380035 Feb 17 18:11:42.085315 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:42.127033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79e0069-2159-4a02-af60-db4b2ab0ea2d req-34830138-9b86-4653-8e20-76615d9bfa20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:42.128916 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a79e0069-2159-4a02-af60-db4b2ab0ea2d req-34830138-9b86-4653-8e20-76615d9bfa20 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=6755b14b-f6f6-43aa-a697-3921175c5230&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1472669 Feb 17 18:11:42.150053 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-7126381f-44d6-4fc9-8f7b-14eaef319c1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:08:48Z', 'revision_number': 4, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': 'babc7f9f-a62e-4d31-9f66-a2e5ad339378', 'name': '', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'mac_address': 'fa:16:3e:6a:c4:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:47Z', 'updated_at': '2021-02-17T18:08:59Z', 'revision_number': 5, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'subnets': [{'id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:42.155643 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7126381f-44d6-4fc9-8f7b-14eaef319c1e None None] The sync data for ids ['742dfc39-339a-428f-8a3f-88d236afaaf4'] in dv-cinder-760194-3-iscsi is: [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:08:48Z', 'revision_number': 4, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_interfaces': [{'id': 'babc7f9f-a62e-4d31-9f66-a2e5ad339378', 'name': '', 'network_id': '6755b14b-f6f6-43aa-a697-3921175c5230', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'mac_address': 'fa:16:3e:6a:c4:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:47Z', 'updated_at': '2021-02-17T18:08:59Z', 'revision_number': 5, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'subnets': [{'id': '8a96f440-286f-407f-9d7e-b3b2727a69a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}] {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:11:42.439666 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-d8551f05-f3c7-4a34-8cb1-a1a8a9ed320a service neutron] 10.222.0.13 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3415179 Feb 17 18:11:42.541760 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a79e0069-2159-4a02-af60-db4b2ab0ea2d req-18b59b64-2535-45ae-82ca-d1ffebc26366 service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3623443 Feb 17 18:11:42.594479 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497774b2-15d4-40bb-a042-3804666f05b8 req-fde2173a-1ba4-4234-aced-674f3f96d1d2 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:42.596688 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-497774b2-15d4-40bb-a042-3804666f05b8 req-fde2173a-1ba4-4234-aced-674f3f96d1d2 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 946 time: 0.3209820 Feb 17 18:11:42.606611 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 60040) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:42.614883 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.v2.base [None req-23deef9a-a522-4283-84b1-22bf35a54de8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Request body: {'floatingip': {'port_id': 'b0cd9fce-7034-4af7-8516-b7d5d3eaf552'}} {{(pid=84112) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 17 18:11:42.708721 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-23deef9a-a522-4283-84b1-22bf35a54de8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for floatingip, before_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:42.715512 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6cfc78c-6df1-44c5-9a3c-4d79ada814c9 None None] New status for floating IP d16e92b6-080c-4b6e-b2ce-a52b5f44c6fe: DOWN {{(pid=84114) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:272}} Feb 17 18:11:42.741604 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-42fbbea7-efe0-4639-b94c-2df5f22373c2 req-3c29d402-0a01-47fa-98d8-13fb77b72204 service neutron] 10.222.0.13 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2874544 Feb 17 18:11:42.760271 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-a79e0069-2159-4a02-af60-db4b2ab0ea2d req-f4f4b1b8-315d-4c8e-9ac5-af761a669390 service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.2002828 Feb 17 18:11:42.794346 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:42.943297 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-62bd0275-a1dc-4fd1-9ca7-af43ce28aef0 req-d48264c0-337a-484c-ae25-722b1bb6aa45 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 272 time: 0.1199453 Feb 17 18:11:43.084222 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62bd0275-a1dc-4fd1-9ca7-af43ce28aef0 req-d110cd34-defe-48dd-8d7e-21a2438348e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:43.086781 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-62bd0275-a1dc-4fd1-9ca7-af43ce28aef0 req-d110cd34-defe-48dd-8d7e-21a2438348e5 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=5729c656e2c64606a663d6434a5c3973&device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 1162 time: 0.1201675 Feb 17 18:11:43.277636 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62bd0275-a1dc-4fd1-9ca7-af43ce28aef0 req-f8baf2dd-4935-4c5c-a133-e03c45fcc59b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:43.279453 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-62bd0275-a1dc-4fd1-9ca7-af43ce28aef0 req-f8baf2dd-4935-4c5c-a133-e03c45fcc59b service neutron] 10.222.0.70 "GET /v2.0/networks?id=6755b14b-f6f6-43aa-a697-3921175c5230 HTTP/1.1" status: 200 len: 909 time: 0.1686602 Feb 17 18:11:43.402341 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-62bd0275-a1dc-4fd1-9ca7-af43ce28aef0 req-90941f79-199f-4da4-b91c-06bbd64abbe7 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 200 len: 217 time: 0.1110120 Feb 17 18:11:43.502076 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62bd0275-a1dc-4fd1-9ca7-af43ce28aef0 req-8524c59c-45bb-447e-81ef-64c588035e0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:43.502076 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-62bd0275-a1dc-4fd1-9ca7-af43ce28aef0 req-8524c59c-45bb-447e-81ef-64c588035e0d service neutron] 10.222.0.70 "GET /v2.0/subnets?id=8a96f440-286f-407f-9d7e-b3b2727a69a9 HTTP/1.1" status: 200 len: 854 time: 0.0920665 Feb 17 18:11:43.620506 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62bd0275-a1dc-4fd1-9ca7-af43ce28aef0 req-534f40aa-10f1-4cb4-993d-54b4728f6019 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:43.622855 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-62bd0275-a1dc-4fd1-9ca7-af43ce28aef0 req-534f40aa-10f1-4cb4-993d-54b4728f6019 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=6755b14b-f6f6-43aa-a697-3921175c5230&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1170752 Feb 17 18:11:43.722412 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-23deef9a-a522-4283-84b1-22bf35a54de8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks [] for floatingip, precommit_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:43.754241 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-23deef9a-a522-4283-84b1-22bf35a54de8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port--9223372036854376515'] for floatingip, after_update {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:43.797836 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-62bd0275-a1dc-4fd1-9ca7-af43ce28aef0 req-7a84c3ce-87be-40bd-8d3f-2e2abc421e95 service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1663949 Feb 17 18:11:43.960095 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.db.l3_db [None req-23deef9a-a522-4283-84b1-22bf35a54de8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Floating IP 77a3c398-b887-44e0-a436-e60465cf0adc associated. External IP: 172.27.1.134, port: b0cd9fce-7034-4af7-8516-b7d5d3eaf552. Feb 17 18:11:44.118698 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:11:44.214764 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-62bd0275-a1dc-4fd1-9ca7-af43ce28aef0 req-fcecafd4-7aeb-463f-9e4f-1991e36480b4 service neutron] 10.222.0.70 "GET /v2.0/networks/6755b14b-f6f6-43aa-a697-3921175c5230?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.4091690 Feb 17 18:11:44.594310 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-23deef9a-a522-4283-84b1-22bf35a54de8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 has already been hosted by L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b {{(pid=84112) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:130}} Feb 17 18:11:44.842033 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-23deef9a-a522-4283-84b1-22bf35a54de8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84112) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:11:44.847303 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-23deef9a-a522-4283-84b1-22bf35a54de8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for floatingip, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:44.852518 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaea2f24-0600-4a2a-aa73-a6d41f0bdf85 None None] Sync routers for ids ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'] in dv-cinder-760194-3-iscsi {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:11:44.863394 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaea2f24-0600-4a2a-aa73-a6d41f0bdf85 None None] Routers {'26ce0b68-6f29-498d-8e7d-e9fdae0ac663'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:11:44.864109 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-aaea2f24-0600-4a2a-aa73-a6d41f0bdf85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:11:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:44.906430 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-23deef9a-a522-4283-84b1-22bf35a54de8 tempest-AttachVolumeShelveTestJSON-184352238 tempest-AttachVolumeShelveTestJSON-184352238-project] 10.222.0.13 "PUT /v2.0/floatingips/77a3c398-b887-44e0-a436-e60465cf0adc HTTP/1.1" status: 200 len: 992 time: 2.2983582 Feb 17 18:11:44.907131 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2ac770d4-c8d6-4a2b-90fa-2001b634f273', 'tag': 'b0cd9fce-7034-4af7-8516-b7d5d3eaf552'}] {{(pid=84112) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:11:45.082360 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2ac770d4-c8d6-4a2b-90fa-2001b634f273', 'tag': 'b0cd9fce-7034-4af7-8516-b7d5d3eaf552', 'status': 'completed', 'code': 200} Feb 17 18:11:45.091805 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-aaea2f24-0600-4a2a-aa73-a6d41f0bdf85 None None] Set router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:11:45.217354 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dbacc16-61fa-4383-8223-339300646f11 req-3b136c1c-b295-463c-aee1-f5a1cca22749 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:45.219019 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4dbacc16-61fa-4383-8223-339300646f11 req-3b136c1c-b295-463c-aee1-f5a1cca22749 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 1163 time: 0.1029971 Feb 17 18:11:45.382890 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dbacc16-61fa-4383-8223-339300646f11 req-1101eb5a-fd85-4609-9333-6364d6f37c1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:45.384762 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4dbacc16-61fa-4383-8223-339300646f11 req-1101eb5a-fd85-4609-9333-6364d6f37c1b service neutron] 10.222.0.70 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 907 time: 0.1587596 Feb 17 18:11:45.497292 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-aaea2f24-0600-4a2a-aa73-a6d41f0bdf85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:07:06Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_floatingips': [{'id': '77a3c398-b887-44e0-a436-e60465cf0adc', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'floating_ip_address': '172.27.1.134', 'floating_network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'router_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'port_id': 'b0cd9fce-7034-4af7-8516-b7d5d3eaf552', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'mac_address': 'fa:16:3e:98:ad:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ac770d4-c8d6-4a2b-90fa-2001b634f273', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-02-17T18:11:26Z', 'updated_at': '2021-02-17T18:11:43Z', 'revision_number': 1, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3837ab39-c6c1-4f34-9b6b-47c98bdea645', 'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'mac_address': 'fa:16:3e:7a:00:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_interface', 'standard_attr_id': 120, 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:07:00Z', 'updated_at': '2021-02-17T18:07:17Z', 'revision_number': 5, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'subnets': [{'id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:45.499230 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4dbacc16-61fa-4383-8223-339300646f11 req-4543b053-1c51-49ad-8ff5-5379988ee937 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b0cd9fce-7034-4af7-8516-b7d5d3eaf552 HTTP/1.1" status: 200 len: 1000 time: 0.1067381 Feb 17 18:11:45.502789 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaea2f24-0600-4a2a-aa73-a6d41f0bdf85 None None] Checking router: 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 for host: dv-cinder-760194-3-iscsi {{(pid=84113) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:11:45.512488 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaea2f24-0600-4a2a-aa73-a6d41f0bdf85 None None] Routers {'26ce0b68-6f29-498d-8e7d-e9fdae0ac663'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:11:45.513174 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-aaea2f24-0600-4a2a-aa73-a6d41f0bdf85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:11:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:45.572348 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dbacc16-61fa-4383-8223-339300646f11 req-3fb3daa0-57f9-426b-ac15-10e40c783c90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:45.574090 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4dbacc16-61fa-4383-8223-339300646f11 req-3fb3daa0-57f9-426b-ac15-10e40c783c90 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2f43211a-7773-487d-8b86-a136c7f7c156 HTTP/1.1" status: 200 len: 852 time: 0.0679305 Feb 17 18:11:45.704483 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dbacc16-61fa-4383-8223-339300646f11 req-09531f46-2222-4992-bdd2-00410c2aa5ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:45.706707 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4dbacc16-61fa-4383-8223-339300646f11 req-09531f46-2222-4992-bdd2-00410c2aa5ba service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1196795 Feb 17 18:11:45.736733 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 60122) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:45.876312 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4dbacc16-61fa-4383-8223-339300646f11 req-90a06676-5353-44e8-9ba2-9c3e51c780e3 service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1546111 Feb 17 18:11:45.882330 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-aaea2f24-0600-4a2a-aa73-a6d41f0bdf85 None None] Set router 26ce0b68-6f29-498d-8e7d-e9fdae0ac663 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:11:45.890625 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f9cc2a9a-3358-4318-848e-b2886d7841f0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:45.907169 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f9cc2a9a-3358-4318-848e-b2886d7841f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:45.911766 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f9cc2a9a-3358-4318-848e-b2886d7841f0 admin admin] Usage tracker for resource:security_group_rule and tenant:6622209bdacb456d9532caa4f01d2c2e is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:45.914929 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-f9cc2a9a-3358-4318-848e-b2886d7841f0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:45.921071 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-f9cc2a9a-3358-4318-848e-b2886d7841f0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:46.018722 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f9cc2a9a-3358-4318-848e-b2886d7841f0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:46.028248 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-4dbacc16-61fa-4383-8223-339300646f11 req-f7a6ebd8-6713-4967-8ed9-5b6d6a12b0ee service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1447589 Feb 17 18:11:46.067058 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-f9cc2a9a-3358-4318-848e-b2886d7841f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:46.077366 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e35f5a8f-4899-4e5b-a972-050b9bddbccd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:46.123947 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-f9cc2a9a-3358-4318-848e-b2886d7841f0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6622209bdacb456d9532caa4f01d2c2e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3860250 Feb 17 18:11:46.126916 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 60134) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:46.160995 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9cc2a9a-3358-4318-848e-b2886d7841f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf5de594-5e88-402b-bfd0-3168d62bdbf9,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:46.170657 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-f9cc2a9a-3358-4318-848e-b2886d7841f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:46.216057 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-89647a3d-32ae-4f95-84d1-dd80f18a0386 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:46.249675 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-89647a3d-32ae-4f95-84d1-dd80f18a0386 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:46.284801 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-aaea2f24-0600-4a2a-aa73-a6d41f0bdf85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:07:06Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_floatingips': [{'id': '77a3c398-b887-44e0-a436-e60465cf0adc', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'floating_ip_address': '172.27.1.134', 'floating_network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'router_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'port_id': 'b0cd9fce-7034-4af7-8516-b7d5d3eaf552', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'mac_address': 'fa:16:3e:98:ad:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ac770d4-c8d6-4a2b-90fa-2001b634f273', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-02-17T18:11:26Z', 'updated_at': '2021-02-17T18:11:43Z', 'revision_number': 1, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3837ab39-c6c1-4f34-9b6b-47c98bdea645', 'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'mac_address': 'fa:16:3e:7a:00:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_interface', 'standard_attr_id': 120, 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:07:00Z', 'updated_at': '2021-02-17T18:07:17Z', 'revision_number': 5, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'subnets': [{'id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:46.289782 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaea2f24-0600-4a2a-aa73-a6d41f0bdf85 None None] The sync data for ids ['26ce0b68-6f29-498d-8e7d-e9fdae0ac663'] in dv-cinder-760194-3-iscsi is: [{'id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'name': 'tempest-AttachVolumeShelveTestJSON-757239-router', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123'}], 'enable_snat': True}, 'gw_port_id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:06:47Z', 'updated_at': '2021-02-17T18:07:06Z', 'revision_number': 4, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'gw_port': {'id': '03f689c4-eeed-4472-ab9d-f14a0929a430', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:29:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_gateway', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:06:49Z', 'updated_at': '2021-02-17T18:07:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi', '_floatingips': [{'id': '77a3c398-b887-44e0-a436-e60465cf0adc', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'floating_ip_address': '172.27.1.134', 'floating_network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'router_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'port_id': 'b0cd9fce-7034-4af7-8516-b7d5d3eaf552', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'mac_address': 'fa:16:3e:98:ad:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2ac770d4-c8d6-4a2b-90fa-2001b634f273', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-02-17T18:11:26Z', 'updated_at': '2021-02-17T18:11:43Z', 'revision_number': 1, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3837ab39-c6c1-4f34-9b6b-47c98bdea645', 'name': '', 'network_id': '8e56c377-33ba-47b0-9d75-fa2421d9f1e2', 'tenant_id': 'bd48a3996f1246f1ab69d3866874af0b', 'mac_address': 'fa:16:3e:7a:00:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '26ce0b68-6f29-498d-8e7d-e9fdae0ac663', 'device_owner': 'network:router_interface', 'standard_attr_id': 120, 'fixed_ips': [{'subnet_id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:07:00Z', 'updated_at': '2021-02-17T18:07:17Z', 'revision_number': 5, 'project_id': 'bd48a3996f1246f1ab69d3866874af0b', 'subnets': [{'id': '2f43211a-7773-487d-8b86-a136c7f7c156', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1450}]}] {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:11:46.387040 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-89647a3d-32ae-4f95-84d1-dd80f18a0386 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:46.392593 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-1e5523e4-0d7a-46c3-88b7-9832eba06934 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:46.405429 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89647a3d-32ae-4f95-84d1-dd80f18a0386 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf5de594-5e88-402b-bfd0-3168d62bdbf9,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:46.408111 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-89647a3d-32ae-4f95-84d1-dd80f18a0386 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:46.411757 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-89647a3d-32ae-4f95-84d1-dd80f18a0386 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:46.424391 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-89647a3d-32ae-4f95-84d1-dd80f18a0386 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/cf5de594-5e88-402b-bfd0-3168d62bdbf9 HTTP/1.1" status: 204 len: 168 time: 0.2956653 Feb 17 18:11:46.596339 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d51f6bed-328f-4a4d-ae28-f16565460f0f None None] New status for floating IP 77a3c398-b887-44e0-a436-e60465cf0adc: ACTIVE {{(pid=84114) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:272}} Feb 17 18:11:46.908380 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0af562e-4822-463f-9445-3292ae68c019 req-3dd69c57-cade-4d35-8e54-487ec2ba9735 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:46.909325 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-f0af562e-4822-463f-9445-3292ae68c019 req-3dd69c57-cade-4d35-8e54-487ec2ba9735 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Synchronizing usage tracker for tenant:5729c656e2c64606a663d6434a5c3973 on resource:port {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:11:46.941592 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 60152) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:46.948622 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-f0af562e-4822-463f-9445-3292ae68c019 req-3dd69c57-cade-4d35-8e54-487ec2ba9735 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Unset dirty status for tenant:5729c656e2c64606a663d6434a5c3973 on resource:port {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:11:46.950338 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f0af562e-4822-463f-9445-3292ae68c019 req-3dd69c57-cade-4d35-8e54-487ec2ba9735 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.1381550 Feb 17 18:11:46.962042 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e15440a0-1ab2-43c6-811d-3aba3e12a47d admin admin] Notify callbacks [] for security_group, before_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:46.981304 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e15440a0-1ab2-43c6-811d-3aba3e12a47d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:221}} Feb 17 18:11:46.986914 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e15440a0-1ab2-43c6-811d-3aba3e12a47d admin admin] Usage tracker for resource:security_group_rule and tenant:e74acb95660446b0af9627366aa67bbc is out of sync, need to count used quota {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:273}} Feb 17 18:11:46.989945 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [None req-e15440a0-1ab2-43c6-811d-3aba3e12a47d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=84112) count_used /opt/stack/neutron/neutron/quota/resource.py:293}} Feb 17 18:11:46.996181 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.quota.driver [None req-e15440a0-1ab2-43c6-811d-3aba3e12a47d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=84112) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:253}} Feb 17 18:11:47.007458 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-f0af562e-4822-463f-9445-3292ae68c019 req-6b6f1923-b58e-4360-8b80-ddd4028ee4a4 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Synchronizing usage tracker for tenant:5729c656e2c64606a663d6434a5c3973 on resource:security_group {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:11:47.057287 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-f0af562e-4822-463f-9445-3292ae68c019 req-6b6f1923-b58e-4360-8b80-ddd4028ee4a4 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Unset dirty status for tenant:5729c656e2c64606a663d6434a5c3973 on resource:security_group {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:11:47.058629 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f0af562e-4822-463f-9445-3292ae68c019 req-6b6f1923-b58e-4360-8b80-ddd4028ee4a4 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1009655 Feb 17 18:11:47.081873 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e15440a0-1ab2-43c6-811d-3aba3e12a47d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:47.102755 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e15440a0-1ab2-43c6-811d-3aba3e12a47d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_create {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:47.115820 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-46423860-f062-4cea-80ba-80ea2f817b4c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:47.159375 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-e15440a0-1ab2-43c6-811d-3aba3e12a47d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e74acb95660446b0af9627366aa67bbc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2165992 Feb 17 18:11:47.160350 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e15440a0-1ab2-43c6-811d-3aba3e12a47d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=58847972-d633-4e27-be8e-91473c9c0d6b,revision_number=1']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:47.162152 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84111) accepted ('10.222.0.13', 60156) {{(pid=84111) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:47.163664 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-e15440a0-1ab2-43c6-811d-3aba3e12a47d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:47.232446 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8c93cde4-b6ed-4a23-b572-783a1e5beff4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:47.260344 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8c93cde4-b6ed-4a23-b572-783a1e5beff4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:47.337100 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8c93cde4-b6ed-4a23-b572-783a1e5beff4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1629451'] for security_group, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:47.342516 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-a540350b-5663-489a-93dc-a63b82db2574 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:47.353227 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c93cde4-b6ed-4a23-b572-783a1e5beff4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58847972-d633-4e27-be8e-91473c9c0d6b,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:47.357942 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-8c93cde4-b6ed-4a23-b572-783a1e5beff4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:47.359907 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8c93cde4-b6ed-4a23-b572-783a1e5beff4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:47.361108 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-8c93cde4-b6ed-4a23-b572-783a1e5beff4 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/58847972-d633-4e27-be8e-91473c9c0d6b HTTP/1.1" status: 204 len: 168 time: 0.1970420 Feb 17 18:11:47.758683 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:48.261794 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f196bd7c-0a35-4b94-be34-4c9b8a68bd44 req-6de12c8a-d753-4200-bdbc-b978b17de70c tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:48.263423 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f196bd7c-0a35-4b94-be34-4c9b8a68bd44 req-6de12c8a-d753-4200-bdbc-b978b17de70c tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.0885220 Feb 17 18:11:48.316177 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f196bd7c-0a35-4b94-be34-4c9b8a68bd44 req-fb8fb141-ec30-4412-937e-3dcc30a8700e tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455649 Feb 17 18:11:49.153291 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357f66e9-5538-4f17-b18a-dd7b6d5efaad req-2286ec1d-f86a-4b55-8679-dc3d2e89c623 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:49.154752 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-357f66e9-5538-4f17-b18a-dd7b6d5efaad req-2286ec1d-f86a-4b55-8679-dc3d2e89c623 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.70 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.0858057 Feb 17 18:11:49.237094 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-357f66e9-5538-4f17-b18a-dd7b6d5efaad req-9a35023d-da9b-4387-a990-99d3d9740293 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Deleting port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 {{(pid=84111) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:11:49.237475 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-357f66e9-5538-4f17-b18a-dd7b6d5efaad req-9a35023d-da9b-4387-a990-99d3d9740293 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:49.572245 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [req-357f66e9-5538-4f17-b18a-dd7b6d5efaad req-9a35023d-da9b-4387-a990-99d3d9740293 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] For port e5b8b8b3-6466-4164-8a2d-7627684ce9d0, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='openvswitch',host='hv-cinder-76019',level=0,port_id=e5b8b8b3-6466-4164-8a2d-7627684ce9d0,segment=NetworkSegment(26bc7590-668d-4f62-883e-3f8e0fb997b0),segment_id=26bc7590-668d-4f62-883e-3f8e0fb997b0)] {{(pid=84111) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:11:49.572848 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-357f66e9-5538-4f17-b18a-dd7b6d5efaad req-9a35023d-da9b-4387-a990-99d3d9740293 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:49.711896 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [req-357f66e9-5538-4f17-b18a-dd7b6d5efaad req-9a35023d-da9b-4387-a990-99d3d9740293 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Calling delete_port for e5b8b8b3-6466-4164-8a2d-7627684ce9d0 owned by compute:nova {{(pid=84111) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:11:49.748671 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f3cad9-e3c1-47ca-8d97-a14e386beb1f req-d67965c6-801e-49b4-8653-f0038f46ae2f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:11:49.750402 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f2f3cad9-e3c1-47ca-8d97-a14e386beb1f req-d67965c6-801e-49b4-8653-f0038f46ae2f tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 945 time: 0.3097396 Feb 17 18:11:49.824705 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-f2f3cad9-e3c1-47ca-8d97-a14e386beb1f req-a8e85aa3-e50a-4873-912d-c8d63d32efdd tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/security-groups?id=d20c28cb-f883-4a6f-897a-3150a1a1bbfe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618732 Feb 17 18:11:49.931039 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-357f66e9-5538-4f17-b18a-dd7b6d5efaad req-9a35023d-da9b-4387-a990-99d3d9740293 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036850650756'] for port, after_delete {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:49.947368 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-2342ffd3-a8cf-4184-afd3-e3e6881a3177 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:50.042676 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a35023d-da9b-4387-a990-99d3d9740293 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Pushing event deleted for resources: {'Port': ['ID=e5b8b8b3-6466-4164-8a2d-7627684ce9d0,revision_number=None']} {{(pid=84111) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:50.050160 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9a35023d-da9b-4387-a990-99d3d9740293 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=84111) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:50.162884 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [req-357f66e9-5538-4f17-b18a-dd7b6d5efaad req-9a35023d-da9b-4387-a990-99d3d9740293 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] No DVR routers for this DVR port e5b8b8b3-6466-4164-8a2d-7627684ce9d0 on host hv-cinder-76019 {{(pid=84111) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:216}} Feb 17 18:11:50.166398 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [req-357f66e9-5538-4f17-b18a-dd7b6d5efaad req-9a35023d-da9b-4387-a990-99d3d9740293 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification--9223372036854625894'] for port, before_response {{(pid=84111) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:50.169888 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'name': 'network-vif-deleted', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0'}] {{(pid=84111) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Feb 17 18:11:50.196189 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e5b8b8b3-6466-4164-8a2d-7627684ce9d0 no longer exists at agent ovs-agent-hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:11:50.206597 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-357f66e9-5538-4f17-b18a-dd7b6d5efaad req-9a35023d-da9b-4387-a990-99d3d9740293 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.70 "DELETE /v2.0/ports/e5b8b8b3-6466-4164-8a2d-7627684ce9d0 HTTP/1.1" status: 204 len: 173 time: 1.0440581 Feb 17 18:11:50.245690 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] No Port match for: e5b8b8b3-6466-4164-8a2d-7627684ce9d0 {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:11:50.246094 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Device e5b8b8b3-6466-4164-8a2d-7627684ce9d0 not bound to the agent host hv-cinder-76019 {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:11:50.259317 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '980eb8bd-e651-4e0e-a5a4-8592d1429535', 'name': 'network-vif-deleted', 'tag': 'e5b8b8b3-6466-4164-8a2d-7627684ce9d0', 'status': 'completed', 'code': 200} Feb 17 18:11:51.198253 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-73f46bcb-b98e-4747-bb72-71c7b1482e73 req-48e5ce6d-43c0-459b-a644-39f1718a3db4 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Synchronizing usage tracker for tenant:5729c656e2c64606a663d6434a5c3973 on resource:port {{(pid=84111) resync /opt/stack/neutron/neutron/quota/resource.py:243}} Feb 17 18:11:51.272530 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.quota.resource [req-73f46bcb-b98e-4747-bb72-71c7b1482e73 req-48e5ce6d-43c0-459b-a644-39f1718a3db4 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] Unset dirty status for tenant:5729c656e2c64606a663d6434a5c3973 on resource:port {{(pid=84111) _resync /opt/stack/neutron/neutron/quota/resource.py:235}} Feb 17 18:11:51.273849 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-73f46bcb-b98e-4747-bb72-71c7b1482e73 req-48e5ce6d-43c0-459b-a644-39f1718a3db4 tempest-TestMinimumBasicScenario-1062374007 tempest-TestMinimumBasicScenario-1062374007-project] 10.222.0.13 "GET /v2.0/ports?device_id=980eb8bd-e651-4e0e-a5a4-8592d1429535 HTTP/1.1" status: 200 len: 210 time: 0.3107510 Feb 17 18:11:53.874137 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 60322) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:54.449953 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal--9223372036854371425'] for router_interface, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:54.816322 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] Deleting port babc7f9f-a62e-4d31-9f66-a2e5ad339378 {{(pid=84112) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:11:54.816698 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:54.996849 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] For port babc7f9f-a62e-4d31-9f66-a2e5ad339378, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=babc7f9f-a62e-4d31-9f66-a2e5ad339378,segment=NetworkSegment(26bc7590-668d-4f62-883e-3f8e0fb997b0),segment_id=26bc7590-668d-4f62-883e-3f8e0fb997b0)] {{(pid=84112) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:11:54.997427 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:55.130360 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] Calling delete_port for babc7f9f-a62e-4d31-9f66-a2e5ad339378 owned by network:router_interface {{(pid=84112) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:11:55.701330 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:55.717128 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:55.816953 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] Pushing event deleted for resources: {'Port': ['ID=babc7f9f-a62e-4d31-9f66-a2e5ad339378,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:55.821509 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:56.121148 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1687174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal--9223372036854371343'] for router_interface, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:56.665102 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] Router 742dfc39-339a-428f-8a3f-88d236afaaf4 has already been hosted by L3 agent 2116c5dc-d5eb-417e-9d3c-934bd7f0527b {{(pid=84112) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:130}} Feb 17 18:11:56.868882 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] Notify agent at l3_agent.dv-cinder-760194-3-iscsi the message routers_updated {{(pid=84112) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:69}} Feb 17 18:11:56.882858 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60b78822-8f15-44fa-97e6-8a945ed5cfe6 None None] Sync routers for ids ['742dfc39-339a-428f-8a3f-88d236afaaf4'] in dv-cinder-760194-3-iscsi {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:127}} Feb 17 18:11:56.888589 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60b78822-8f15-44fa-97e6-8a945ed5cfe6 None None] Routers {'742dfc39-339a-428f-8a3f-88d236afaaf4'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:11:56.889260 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-60b78822-8f15-44fa-97e6-8a945ed5cfe6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:11:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['742dfc39-339a-428f-8a3f-88d236afaaf4'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:56.922640 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-9fcdcd0f-8f7c-4175-b9fd-133eb32db33d admin admin] 10.222.0.13 "PUT /v2.0/routers/742dfc39-339a-428f-8a3f-88d236afaaf4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0472293 Feb 17 18:11:56.925374 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.wsgi [-] (84112) accepted ('10.222.0.13', 60352) {{(pid=84112) server /usr/local/lib/python3.6/dist-packages/eventlet/wsgi.py:992}} Feb 17 18:11:57.097489 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-60b78822-8f15-44fa-97e6-8a945ed5cfe6 None None] Set router 742dfc39-339a-428f-8a3f-88d236afaaf4 gateway port host: dv-cinder-760194-3-iscsi {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:11:57.130494 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Notify callbacks [] for router, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:57.334303 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:57.371023 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Deleting port fd31815c-e811-4884-b0eb-8ac1112bed3e {{(pid=84112) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1876}} Feb 17 18:11:57.371407 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback--9223363306798028916'] for port, before_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:57.436378 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-60b78822-8f15-44fa-97e6-8a945ed5cfe6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'external_fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224'}], 'enable_snat': True}, 'gw_port_id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:11:55Z', 'revision_number': 5, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port': {'id': 'fd31815c-e811-4884-b0eb-8ac1112bed3e', 'name': '', 'network_id': '68fd415f-8606-43f8-b4d1-98e6a9c9af94', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:bd:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 369, 'fixed_ips': [{'subnet_id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'ip_address': '172.27.1.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760194-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-02-17T18:08:41Z', 'updated_at': '2021-02-17T18:08:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1c895d8f-55ff-4bdb-a323-742172b9934e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760194-3-iscsi'}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:57.441242 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60b78822-8f15-44fa-97e6-8a945ed5cfe6 None None] Checking router: 742dfc39-339a-428f-8a3f-88d236afaaf4 for host: dv-cinder-760194-3-iscsi {{(pid=84113) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:156}} Feb 17 18:11:57.450552 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60b78822-8f15-44fa-97e6-8a945ed5cfe6 None None] Routers {'742dfc39-339a-428f-8a3f-88d236afaaf4'} bound to L3 agent in host dv-cinder-760194-3-iscsi {{(pid=84113) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Feb 17 18:11:57.451258 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-60b78822-8f15-44fa-97e6-8a945ed5cfe6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760194-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-02-17T17:57:40Z,description=,heartbeat_timestamp=2021-02-17T18:11:40Z,host='dv-cinder-760194-3-iscsi',id=2116c5dc-d5eb-417e-9d3c-934bd7f0527b,load=0,resource_versions=,resources_synced=,started_at=2021-02-17T17:57:40Z,topic='l3_agent')) {'router_ids': ['742dfc39-339a-428f-8a3f-88d236afaaf4'], 'active': True} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:57.569618 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.db [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] For port fd31815c-e811-4884-b0eb-8ac1112bed3e, host dv-cinder-760194-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760194-3-iscsi',level=0,port_id=fd31815c-e811-4884-b0eb-8ac1112bed3e,segment=NetworkSegment(b5e97d06-6722-4de8-9658-658adc74c7b4),segment_id=b5e97d06-6722-4de8-9658-658adc74c7b4)] {{(pid=84112) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:78}} Feb 17 18:11:57.570210 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-457073'] for port, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:57.638922 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_dvr_db [None req-60b78822-8f15-44fa-97e6-8a945ed5cfe6 None None] Set router 742dfc39-339a-428f-8a3f-88d236afaaf4 gateway port host: None {{(pid=84113) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:803}} Feb 17 18:11:57.708008 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Calling delete_port for fd31815c-e811-4884-b0eb-8ac1112bed3e owned by network:router_gateway {{(pid=84112) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1949}} Feb 17 18:11:57.755351 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.l3_hamode_db [None req-60b78822-8f15-44fa-97e6-8a945ed5cfe6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:11:57Z', 'revision_number': 6, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port_host': None}], 'dv-cinder-760194-3-iscsi', False) {} {{(pid=84113) wrapper /usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py:66}} Feb 17 18:11:57.759405 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60b78822-8f15-44fa-97e6-8a945ed5cfe6 None None] The sync data for ids ['742dfc39-339a-428f-8a3f-88d236afaaf4'] in dv-cinder-760194-3-iscsi is: [{'id': '742dfc39-339a-428f-8a3f-88d236afaaf4', 'name': 'tempest-TestMinimumBasicScenario-1483897094-router', 'tenant_id': '5729c656e2c64606a663d6434a5c3973', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-02-17T18:08:39Z', 'updated_at': '2021-02-17T18:11:57Z', 'revision_number': 6, 'project_id': '5729c656e2c64606a663d6434a5c3973', 'gw_port_host': None}] {{(pid=84113) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:140}} Feb 17 18:11:57.972407 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1564904', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1989345', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036853088625', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8730056752175', 'neutron.db.l3_dvrscheduler_db._notify_port_delete--9223363306798427406', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted--9223372036852540443'] for port, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:57.989152 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-56b1f6a8-a63e-48d0-9fd6-d1f6084de560 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 18:11:58.305073 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Pushing event deleted for resources: {'Port': ['ID=fd31815c-e811-4884-b0eb-8ac1112bed3e,revision_number=None']} {{(pid=84112) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:243}} Feb 17 18:11:58.314858 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG oslo_concurrency.lockutils [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.326s {{(pid=84112) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 18:11:58.429374 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-456325'] for router_gateway, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:58.616228 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id--9223372036854372299', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-5275'] for router, precommit_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:58.618652 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:58.736794 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network--9223372036854372073'] for router, after_delete {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:58.737392 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 742dfc39-339a-428f-8a3f-88d236afaaf4 {{(pid=84112) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Feb 17 18:11:58.751211 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] Notify callbacks [] for router, before_response {{(pid=84112) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:11:58.752549 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [None req-3bb47f71-8559-4b37-881c-4cb6f1f39872 admin admin] 10.222.0.13 "DELETE /v2.0/routers/742dfc39-339a-428f-8a3f-88d236afaaf4 HTTP/1.1" status: 204 len: 168 time: 1.8261869 Feb 17 18:11:58.776350 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device fd31815c-e811-4884-b0eb-8ac1112bed3e no longer exists at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:11:58.815636 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] No Port match for: fd31815c-e811-4884-b0eb-8ac1112bed3e {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:11:58.816087 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device fd31815c-e811-4884-b0eb-8ac1112bed3e not bound to the agent host dv-cinder-760194-3-iscsi {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:11:58.816589 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device babc7f9f-a62e-4d31-9f66-a2e5ad339378 no longer exists at agent ovs-agent-dv-cinder-760194-3-iscsi {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:245}} Feb 17 18:11:58.854872 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.plugin [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] No Port match for: babc7f9f-a62e-4d31-9f66-a2e5ad339378 {{(pid=84113) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2202}} Feb 17 18:11:58.855301 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.plugins.ml2.rpc [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Device babc7f9f-a62e-4d31-9f66-a2e5ad339378 not bound to the agent host dv-cinder-760194-3-iscsi {{(pid=84113) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:253}} Feb 17 18:12:07.710853 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-317c3627-8c00-430a-865e-2f07265c8165 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:12:09.845080 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-73a25e9d-47a0-499d-8d88-e2ba3d38a4da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:12:10.845422 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:12:12.010788 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:12:12.770494 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:12:17.776408 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:12:21.117864 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:12:37.690173 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b1f57a22-9cf4-4b89-8efa-3ac146f29425 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:12:39.838973 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-145ee75a-cd65-4d15-89d2-3acc47ae9235 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:12:40.838964 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:12:42.004746 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:12:42.770320 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:12:43.853075 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf8df3a0-d134-4090-9a4f-26dd4273a8cf req-429a5ebb-3966-4029-9765-afb2ea023a63 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 272 time: 0.1240582 Feb 17 18:12:44.003060 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8df3a0-d134-4090-9a4f-26dd4273a8cf req-2f827bd4-e1d9-4c46-97f7-e0ed1a04f015 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:12:44.004707 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf8df3a0-d134-4090-9a4f-26dd4273a8cf req-2f827bd4-e1d9-4c46-97f7-e0ed1a04f015 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 1163 time: 0.0807896 Feb 17 18:12:44.162718 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8df3a0-d134-4090-9a4f-26dd4273a8cf req-c98fc1c3-0ba9-4827-a2d9-380278a680dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:12:44.164331 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf8df3a0-d134-4090-9a4f-26dd4273a8cf req-c98fc1c3-0ba9-4827-a2d9-380278a680dc service neutron] 10.222.0.70 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 907 time: 0.1396523 Feb 17 18:12:44.277217 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf8df3a0-d134-4090-9a4f-26dd4273a8cf req-df478e80-0e44-41e5-a7df-a63391c7059b service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b0cd9fce-7034-4af7-8516-b7d5d3eaf552 HTTP/1.1" status: 200 len: 1002 time: 0.1054440 Feb 17 18:12:44.348991 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8df3a0-d134-4090-9a4f-26dd4273a8cf req-32247e93-5e64-4827-ae44-4cc473c45635 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:12:44.350572 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf8df3a0-d134-4090-9a4f-26dd4273a8cf req-32247e93-5e64-4827-ae44-4cc473c45635 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2f43211a-7773-487d-8b86-a136c7f7c156 HTTP/1.1" status: 200 len: 852 time: 0.0632930 Feb 17 18:12:44.436254 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8df3a0-d134-4090-9a4f-26dd4273a8cf req-c261865c-4cf6-4ca0-91ab-7bd211c8ad0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:12:44.437849 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf8df3a0-d134-4090-9a4f-26dd4273a8cf req-c261865c-4cf6-4ca0-91ab-7bd211c8ad0b service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0797706 Feb 17 18:12:44.584887 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf8df3a0-d134-4090-9a4f-26dd4273a8cf req-c05a0e15-a3f5-446c-a03d-6046a88bd0cf service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1402407 Feb 17 18:12:44.726125 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-cf8df3a0-d134-4090-9a4f-26dd4273a8cf req-ae870883-9335-423e-88ec-68682357bc8e service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1339567 Feb 17 18:12:47.808215 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:12:58.117732 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:13:07.684347 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8c6fbfcc-d067-40dc-b995-460f04250e60 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:13:09.844257 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-d6685027-93d0-4f21-affa-4ff337cc5051 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:13:10.848273 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:13:12.015778 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:13:12.756745 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:13:17.825092 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:13:35.117216 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:13:37.698873 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-9a7a1645-a5ac-4c02-b0d6-53351d590a23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:13:39.844596 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c6cb12f8-04b5-48fa-a21a-76cbbb7f092c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:13:40.855100 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:13:42.009910 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:13:42.773189 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:13:45.775190 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ecc2e1b0-80d5-486a-9ed8-cfd34d277d43 req-868b3f7e-5524-4856-ae4c-c358f8db89be service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 272 time: 0.0774479 Feb 17 18:13:45.925140 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc2e1b0-80d5-486a-9ed8-cfd34d277d43 req-b50e0699-c7f8-483c-a891-b447a5d7b353 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:13:45.926673 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ecc2e1b0-80d5-486a-9ed8-cfd34d277d43 req-b50e0699-c7f8-483c-a891-b447a5d7b353 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 1163 time: 0.0782151 Feb 17 18:13:46.315780 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc2e1b0-80d5-486a-9ed8-cfd34d277d43 req-52fb5534-0fa7-4b5e-918d-b3c01d25ebc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:13:46.317480 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ecc2e1b0-80d5-486a-9ed8-cfd34d277d43 req-52fb5534-0fa7-4b5e-918d-b3c01d25ebc1 service neutron] 10.222.0.70 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 907 time: 0.3705468 Feb 17 18:13:46.429743 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ecc2e1b0-80d5-486a-9ed8-cfd34d277d43 req-4edbcb6d-0e5e-41db-8134-226c1156cb7f service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b0cd9fce-7034-4af7-8516-b7d5d3eaf552 HTTP/1.1" status: 200 len: 1002 time: 0.1052680 Feb 17 18:13:46.505903 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc2e1b0-80d5-486a-9ed8-cfd34d277d43 req-03a96afb-60b2-4466-a061-c41c1b3c4597 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:13:46.507472 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ecc2e1b0-80d5-486a-9ed8-cfd34d277d43 req-03a96afb-60b2-4466-a061-c41c1b3c4597 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2f43211a-7773-487d-8b86-a136c7f7c156 HTTP/1.1" status: 200 len: 852 time: 0.0707333 Feb 17 18:13:46.593950 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc2e1b0-80d5-486a-9ed8-cfd34d277d43 req-cd781700-a8a9-4647-bedf-613aadf44feb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:13:46.595542 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ecc2e1b0-80d5-486a-9ed8-cfd34d277d43 req-cd781700-a8a9-4647-bedf-613aadf44feb service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0804474 Feb 17 18:13:46.742559 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ecc2e1b0-80d5-486a-9ed8-cfd34d277d43 req-316d24c6-aff0-4960-a169-10c19a3e8c51 service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1396759 Feb 17 18:13:46.884802 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-ecc2e1b0-80d5-486a-9ed8-cfd34d277d43 req-80317ebc-9084-4d85-a6c2-052184b96db3 service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1355436 Feb 17 18:13:47.855042 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:07.698620 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-e303d2a7-545f-4479-804c-b26276afaa64 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:09.849231 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8444fab8-57e3-4c5d-8c10-27db2fa2ca5d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:10.855205 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:12.014540 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:12.117352 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:14:12.763749 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:17.883062 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:37.682742 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b25dbabf-8c3d-4824-a355-e3440f67c841 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:39.848617 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-a8032718-58f6-4252-ae9f-280116428d09 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:40.848605 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:42.025445 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:42.771936 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:46.788132 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-911a119f-239d-4138-b7ab-636510702068 req-f6141c8d-6449-4855-ab83-e0876e114f9a service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 272 time: 0.0801258 Feb 17 18:14:46.935788 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911a119f-239d-4138-b7ab-636510702068 req-0e5098c4-100a-458e-a1c0-df7a58caec5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:14:46.937351 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-911a119f-239d-4138-b7ab-636510702068 req-0e5098c4-100a-458e-a1c0-df7a58caec5e service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 1163 time: 0.0775151 Feb 17 18:14:47.088871 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911a119f-239d-4138-b7ab-636510702068 req-ee30bd67-ca9e-44a7-ac12-f372f462dbc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:14:47.090487 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-911a119f-239d-4138-b7ab-636510702068 req-ee30bd67-ca9e-44a7-ac12-f372f462dbc0 service neutron] 10.222.0.70 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 907 time: 0.1341839 Feb 17 18:14:47.197864 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-911a119f-239d-4138-b7ab-636510702068 req-d1763367-1b69-426c-a18a-43cacc658ecd service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b0cd9fce-7034-4af7-8516-b7d5d3eaf552 HTTP/1.1" status: 200 len: 1002 time: 0.1005731 Feb 17 18:14:47.264540 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911a119f-239d-4138-b7ab-636510702068 req-387e0f72-94dd-4109-b3fb-31a8fd728054 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:14:47.266075 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-911a119f-239d-4138-b7ab-636510702068 req-387e0f72-94dd-4109-b3fb-31a8fd728054 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2f43211a-7773-487d-8b86-a136c7f7c156 HTTP/1.1" status: 200 len: 852 time: 0.0617418 Feb 17 18:14:47.352689 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911a119f-239d-4138-b7ab-636510702068 req-ce7f228f-a115-41a9-81d9-0129e8c25fae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:14:47.354247 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-911a119f-239d-4138-b7ab-636510702068 req-ce7f228f-a115-41a9-81d9-0129e8c25fae service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0808620 Feb 17 18:14:47.495877 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-911a119f-239d-4138-b7ab-636510702068 req-313adad1-ab29-465c-bf22-d7b0a08a2e02 service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1345940 Feb 17 18:14:47.637944 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-911a119f-239d-4138-b7ab-636510702068 req-02ecb3d0-ad78-47dc-8af7-2696778903cf service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1349819 Feb 17 18:14:47.868998 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:14:49.116858 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:15:07.716735 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-66a59065-a193-4ad2-b939-eaa6de4d7af7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:15:09.853685 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-aedac175-2875-4ed4-8987-b61738a72477 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:15:10.854011 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:15:12.025632 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:15:12.774229 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:15:17.887980 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:15:26.117333 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:15:37.699440 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-c49b3f93-d850-4a98-af7f-e641a2819916 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:15:39.865417 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-70167912-1ce5-4bfd-b05f-238bf7fc6df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:15:40.867911 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:15:42.036418 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:15:42.787792 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:15:47.936893 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:15:49.407479 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9d30cd34-374b-4df3-a7f8-91fc092f4260 req-0a88ad71-70df-454d-8b22-1e745ade8e08 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 272 time: 0.0756316 Feb 17 18:15:49.561267 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d30cd34-374b-4df3-a7f8-91fc092f4260 req-0e9226f0-7441-4da1-8e5e-be8a7761a941 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:15:49.562884 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9d30cd34-374b-4df3-a7f8-91fc092f4260 req-0e9226f0-7441-4da1-8e5e-be8a7761a941 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 1163 time: 0.0820343 Feb 17 18:15:49.719946 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d30cd34-374b-4df3-a7f8-91fc092f4260 req-1a677b62-b0b0-41f0-8ca4-5c9fe6538ad8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:15:49.721461 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9d30cd34-374b-4df3-a7f8-91fc092f4260 req-1a677b62-b0b0-41f0-8ca4-5c9fe6538ad8 service neutron] 10.222.0.70 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 907 time: 0.1371493 Feb 17 18:15:49.831350 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9d30cd34-374b-4df3-a7f8-91fc092f4260 req-6815f09f-9e77-4f72-8395-709bfac58908 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b0cd9fce-7034-4af7-8516-b7d5d3eaf552 HTTP/1.1" status: 200 len: 1002 time: 0.1027529 Feb 17 18:15:49.908566 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d30cd34-374b-4df3-a7f8-91fc092f4260 req-1323d552-1d74-481e-b389-440de7157ba1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:15:49.910233 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9d30cd34-374b-4df3-a7f8-91fc092f4260 req-1323d552-1d74-481e-b389-440de7157ba1 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2f43211a-7773-487d-8b86-a136c7f7c156 HTTP/1.1" status: 200 len: 852 time: 0.0716691 Feb 17 18:15:49.997952 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d30cd34-374b-4df3-a7f8-91fc092f4260 req-fb058d0d-954b-4065-8f17-41c9fb73cde1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:15:49.999690 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9d30cd34-374b-4df3-a7f8-91fc092f4260 req-fb058d0d-954b-4065-8f17-41c9fb73cde1 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0824502 Feb 17 18:15:50.150136 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9d30cd34-374b-4df3-a7f8-91fc092f4260 req-cf0185dd-2d1e-44bb-81d7-f9044e1e0c2b service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1429319 Feb 17 18:15:50.304336 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-9d30cd34-374b-4df3-a7f8-91fc092f4260 req-7e17d97f-1569-469b-be72-9dd47fcf0a2b service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1457603 Feb 17 18:16:03.117730 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:16:07.733001 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-4a841923-4698-469a-a65a-30f674fccc5a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:16:09.878667 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-aa25cbd6-1997-4845-a77f-b0a2cd99e77d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:16:10.867490 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:16:12.047740 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:16:12.804373 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:16:17.941632 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:16:37.712512 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-ca6d72a3-fce3-43a7-9f26-7b544b0548e6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:16:39.886775 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-2c867752-09e6-4e34-af85-48ef706d6fe4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:16:40.117171 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.db.agents_db [None req-6e606fca-30e9-4def-bd62-132e942646c2 None None] Agent healthcheck: found 6 active agents {{(pid=84114) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:326}} Feb 17 18:16:40.875861 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-8b2ed68a-be82-431c-9373-f1efe891f846 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:16:42.040988 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-b369b75b-e4b8-4feb-808b-1d76d26920a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:16:42.784254 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-bf10a60b-d62d-41ef-86a1-df9557506c3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:16:47.944069 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron_lib.callbacks.manager [None req-54d60924-74cd-4a1f-8816-eb1f31a0daaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223363306798072590', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1543009'] for agent, after_update {{(pid=84113) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Feb 17 18:16:49.777171 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-004d268c-8218-454d-9539-2e24985ecbc1 req-664c384b-430f-43b6-bf6b-33b86401854e service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 272 time: 0.0837224 Feb 17 18:16:49.924523 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004d268c-8218-454d-9539-2e24985ecbc1 req-6f9ba612-9f8d-4042-a6d4-5de68a14387a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:16:49.926174 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-004d268c-8218-454d-9539-2e24985ecbc1 req-6f9ba612-9f8d-4042-a6d4-5de68a14387a service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=bd48a3996f1246f1ab69d3866874af0b&device_id=2ac770d4-c8d6-4a2b-90fa-2001b634f273 HTTP/1.1" status: 200 len: 1163 time: 0.0773664 Feb 17 18:16:50.078833 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004d268c-8218-454d-9539-2e24985ecbc1 req-681dcd18-4ae2-40ef-ba46-f1267c30bc89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:16:50.080375 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-004d268c-8218-454d-9539-2e24985ecbc1 req-681dcd18-4ae2-40ef-ba46-f1267c30bc89 service neutron] 10.222.0.70 "GET /v2.0/networks?id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2 HTTP/1.1" status: 200 len: 907 time: 0.1342933 Feb 17 18:16:50.187848 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-004d268c-8218-454d-9539-2e24985ecbc1 req-9bd85f3d-40bd-4863-883f-1b628b565746 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b0cd9fce-7034-4af7-8516-b7d5d3eaf552 HTTP/1.1" status: 200 len: 1002 time: 0.1000147 Feb 17 18:16:50.255825 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004d268c-8218-454d-9539-2e24985ecbc1 req-5375abc1-3fd3-4eb5-a456-5d27a3a08e21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:16:50.257406 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-004d268c-8218-454d-9539-2e24985ecbc1 req-5375abc1-3fd3-4eb5-a456-5d27a3a08e21 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2f43211a-7773-487d-8b86-a136c7f7c156 HTTP/1.1" status: 200 len: 852 time: 0.0631599 Feb 17 18:16:50.340589 dv-cinder-760194-3-iscsi neutron-server[84000]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004d268c-8218-454d-9539-2e24985ecbc1 req-51616c4d-1aa1-4666-8d36-672ca77dae83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=84111) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:256}} Feb 17 18:16:50.342075 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-004d268c-8218-454d-9539-2e24985ecbc1 req-51616c4d-1aa1-4666-8d36-672ca77dae83 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=8e56c377-33ba-47b0-9d75-fa2421d9f1e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0788727 Feb 17 18:16:50.482676 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-004d268c-8218-454d-9539-2e24985ecbc1 req-cd6cad92-8585-4877-876c-c97e24702f7e service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1335416 Feb 17 18:16:50.626836 dv-cinder-760194-3-iscsi neutron-server[84000]: INFO neutron.wsgi [req-004d268c-8218-454d-9539-2e24985ecbc1 req-6474a6d6-1689-4cc7-8ce0-8050efcd2cd1 service neutron] 10.222.0.70 "GET /v2.0/networks/8e56c377-33ba-47b0-9d75-fa2421d9f1e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 276 time: 0.1369867